I grew up on the NY / Pennsylvania border, about 2.5 hours SE of Buffalo. I knew guys that flew the flag. Most of them had no family connection to the south, and most of them were racist, and were not at all shy about being racist.
Again - I understand there are other reasons for displaying a Confederate flag. But in NY state, my experience has been that it is a symbol of racism.