Some people who are quite/shy/introverted types come off as disinterested or arrogant. Usually it's just that.. they're shy, etc.
Not everyone gets all super happy and affectionate all the time. Introverts get mislabeled a lot.
Let's err on the side of caution here and not cast him out just yet.