I don't think Coller has ever claimed to be a good college baseball player, in fact, during the exchange he mentioned that he really wasn't very good at all.
It was just so disturbing because they questioned him professionally, and then he just launches into this personal crusade that he happened to be wrong about.