Weather definitely matters. guys will say it doesn't (because what else are you going to say) but if you don't experience cold, wind and snow much it can be a shock to the system.
It's the time on the bench that's killer. You sweat, even in 8 degree weather, and you're fine. Then you come to the freezing cold bench and sit there for 10-15 minutes and that sweat becomes cold and clammy, and it's miserable.
Any of us who have lived in WNY and been outside in the winter know how to deal with this and/or have become conditioned to it. But if you're not familiar it's got to feel like torture.
Sort of the flip side of playing in Miami and being in the full sun all game when it's 120 degrees on the sideline while the Dolphins are in the shade. It matters.