I am very much convinced that a big downside to being rich is it allows your opinions to ossify. No matter where you started, how hard you worked, or how world-changing (debatable) someone's contributions were, once they get power (in any form, but especially money), it insulates one against having to change. I'm not advocating for austerity all the time, but it's painfully obvious from pretty much every "self-made man" that made it big that they are living in a bubble, full of yes-men because they fired all the people who had the temerity to say "hey, perhaps that's not quite right."
Even though I'm slightly above average in a number of markers and I've taken pains to expand my horizons and take on differing POVs, I'm still surprised (quite often!) by things I just had not thought of. And I'm not even rich, albeit I'm privileged enough to take long breaks from paying work.