I could see it being a tough spot. I think about this with Bienemy in KC as well. You're working with young star QBs and winning a lot, life is good. The OC or DC of a winning team is one of the most popular people in the league... everyone tells you how great you are, fans worry about you leaving, owners of other teams constantly make overtures for HC openings, you win accolades and SB rings, and collect tons of money.
Since you are coaching a guy like Mahomes, for example, you can do no wrong.
Most places you go the cupboard is bare or there is the famous "some talent but no QB" problem. Look at Chicago. Nagy has had good players but no QB, and he could be headed for an exit at the end of the season. Then what?
Suddenly you go from "genius" with a QB who can do anything to a Mitch Trubisky situation, where no matter how hard you try the guy can't cut it. And it's all YOUR FAULT and you get criticized all day long.