There is some validity to the Vinny/Kosar point. Making an unpopular move for the good of the team (see Milloy, Lawyer) is one of his trakemarks.
The 2nd point, I don't know. The hindsight is just that imo. Would those folks be saying the same things if his NE career didn't happen? He won 11 games in his 4th year which is fine, but a lot of guys have a surprise 11win year and are never heard from again. '95 did not look like it was shaping up to be a good year even before the Baltimore announcement/distraction (I'm not sure at what point everyone internally knew about it).