I understand the "i have to live next to them" premise, but the same goes for your neighbors.... they have to live next to you. If someone in your household broke one of their windows, you would take responsibility for it, because you have to live next to them. I used to be passive in situations like this as well, and i'm not advocating flying off the handle about it, but your neighbors didn't do the right thing. You don't want to cause waves with them, but they don't seem to mind causing waves with you.