I did as well when I played (different sport)
In your head there's so many good or bad things that could happen in the next hour or so. Of course by the end of the game you're wondering what you possibly could have been so worried about.
I remember it never got any better with experience for me