Many of those people, myself included, probably don't buy the party line that you can completely divorce business decisions from deeply held personal beliefs.
Would you feel the same way if he'd donated to some far-right group that was against intermarriage between blacks and whites? What about something even more extreme? I don't see how the situation would be fundamentally different, or how your argument that this reaction is "too bad" would no longer apply.