Yeah, that's like "I'm not a racist, but..."
You KNOW the next thing they say will be racist.
And if I ever preface a statement with the phrase "With all due respect," the implication is that the amount due is zero. It's my equivalent of a southerner saying, "Well, bless your heart."