Not all moral issues, negative and positive, are equal to each other. It's also incredibly subjective. Good for Jim that he's trying to do good for people with less than him. In my mind, the immoral behaviour that he's partaken in overshadows the good that he's done. Again, that's subjective because I've been around domestic violence myself. Others don't have to feel that way, the beauty of freedom of thought.
I don't agree that it's a fallacy that, on moral issues, we throw out the character of the person when looking at how we discuss/dissect their viewpoint. Their morality isn't what they say, it's what they do. Actions speaking louder than words. I do not trust the moral compass of Jim Brown but he still has the right to say/believe whatever he wants to.