Yep. And worse...
Some of my old college buddies get together for a weekend every few years. For one of them, the host couple lived on a street where all the houses looked pretty much the same. I went out to my car, which was parked a few houses down, to get something. When I got back to the house, I opened the door, walked in, and saw an older guy sitting in a recliner watching TV. He looked at me, probably thinking "WTF?" I said, "Sorry - wrong house," and high-tailed it out of there. I got the right house on the second try.