Dude...you have too much time on your hands. (j/king at least you are taking the time and really looking at the game then speaking instead of analyzing a box score like the vast majority of sports writers and critics)
Actually, I bet if you looked around the league at all 32 QB times they'd all be between 2.9 and 3.2 for a mean. Like the others have said though, it not just time to the QB that is causing problems. There are other factors that need to be considered in this equation if we are looking at the mere physical aspects of this.
1. Where is the pressure coming from? Blindside pressure will cause more problems than frontside pressure in the same amount of time.
2. Type of play being executed. Generally, you'll have more time from snap to throw for a Play-action pass than a dropback pass, but these plays also take more time to setup.
3. Supporting cast. The quality of receivers and TE's vary dramatically from team to team. The Colts have a solid corps of receivers that help Manning make plays out of nothing. Brady has 2 solid TE's with reliable hands and an offense designed for quick passes. Losman on the other hand is lacking both big play receivers and a reliable TE.
Then it comes down to the mental factor. Manning is being touted as a top 3 all time QB by numerous sources and is a proven winner in months that end in BER. Brady rode a hot streak to a Super Bowl win and never lost his confidence after that.
JP on the other hand has been put in a situation with a less than stellar team, 2 coaches and pro style offenses in 3 years, an expectation of fans to be the next Jim Kelly and lead a mediocre team to a Super Bowl or else get run out of town.
Now, I'm not saying that JP would be the next coming if he were playing for the Colts or Patsies, but I bet his numbers would be better.