When someone is that successful a lot of people will try and write them off. I wrote in another comment, I don't agree with everything he says or does. But he is undoubtedly in the firing line.
Billionaires are uniquely positioned to be, because they tend to get away repeatedly with things that would be career- or life-ending for others.