That's it exactly. Mine wasn't an all day thing, mostly early morning. The good thing is it actually will go away with time on it's own. Are you on your feet a lot? If so I would recommend getting a pair of these, pricey but worth every penny.
I'm on my feet teaching 6-7 hours a day 4-5 days a week and swear by them.