I think a factor in all of this is the messaging in the locker room. The "we're a family that loves each other" talking point that they get a lot of mileage out of.
If Matt is innocent of these allegations, which many say doesn't matter since the distraction isn't worth a punter, can they really just cast him aside due to public pressure?