It would be a large and perpetual task. I manage a volunteer nonprofit account that has only 15k followers compared to his 96k, and I delete a category of pics that we're often tagged in (daily). It sucks.
Folks may be making a mountain out of a mole hill with his instagram deletions, but the tagged photos tab does not cancel out his behavior.