A few years ago me and my buddies from work went to Cleveland for a Bills game. All wearing our bills gear, not a single problem.
In fact, most people said they liked the Bills, and rooted for us when they lost their team. Especially during a draft day, it would be a good conversation starter with the people there.