You have to go into the show with an open mind. If you go in thinking everything they do is stupid and unrealistic, of course you're not going to like the show. It's actually very interesting, IMO. Also, you can't judge the show just on one episode. They do many many investigations, but they only show the better ones on TV because they are the most interesting ones. On the International version, they've gotten hits on the EVP in many other languages than just English. One of the investigators knows a few languages if I remember correctly.
BTW, they don't just investigate large castles and old Victorian places. The only reason they do it on the International version is because they want to hit the most interesting spots. In the original Ghost Hunters show, they do many residential homes and areas. I find their type of investigating much more realistic than other shows on TV, such as Paranormal State on A & E and whatever else is out there. They try to "debunk" phenomenon before they call it paranormal. If you watch the show more regularly, you will notice that they barely ever claim a place haunted. Jason and Grant will say a place has "paranormal activity" which just means that they can't explain what caused it. It takes exceptional evidence for them to say something "haunted".
If you ever want to give it another shot, they investigated a few Buffalo hot spots. They did the Iron Island Museum as well as the Buffalo Central Terminal.