If he was dragging the kid in there or forcing him into things he didn't want to be involved in, then I totally agree with you.
But if the kid was asking to come to the park for home games and he was just trying to spend some extra time with him before he grows up and disappears, then I'm not going to give him hell for it.