When you are building wealth, you are likely to be young (so often healthy) and there is so much information online, libraries cost nothing. So I don't think this is a valid argument.
Only when everybody you care about has a stable health/housing/food/(work) situation you get a chance to do something for yourself. Only if people around you are privileged enough to they have time to invest in you. You can start to build wealth. I don't mean with investing money. Maybe just by
- Lending you their garage - Allowing you to work without income for a few months - Taking care of your kids while you work a few times a week - etc...
TDLR: if all you and your surrounding is doing is directly aimed at surviving you cannot build wealth.