Awww it's always hard to see people go that we have grown fond of! Maybe you can stay in touch with the old pastor, i'm sure he will appreciate that!
Hope you will get to know the new pastor soon, it's always comforting to have someone neutral to talk to