I would argue the other way around: The more wealthy you are...
- the less competent you need to be. You have more capital to do the work for you.
- the less you are affected from random problems, as you can spread your risk.
If you are in the lower echelon, one miss-step or random event outside of your control can bring you in a position where it is much harder to recover from.
(Edited formatting)