I don't think you're wrong for the way you feel. Regardless of money/fame/notoriety though if you go get married you should honor it, not invite/allow (however it came to be) women to throw themselves at you.
If you want to take all that comes your way, great, don't get married.