Black, white, or green, Jackson confuses the hell out of defenses. Some of his fake handoffs have even the cameramen reeling. That is, it's not a black quarterback thing; he's for real. I have to pity the Bills defense attempting to deal with him.
Realistically, NFL referees have a long history of simply being either incompetent or inconsistent, or all of the above. That's why replays came into vogue. The true horror is the concern that some may be on the take as was the case with the NBA loser.
It's simple. When you lose four straight Super Bowls and following that do little that catches anyone's eye for decades, you won't be on prime time TV very often. And it doesn't help that the few occasions you were on during that interim, you generally produced snoozeable efforts.