This is a well documented phenomenon.[0][1] The state of being in poverty has a significant effect on your cognitive processes evaluating risk and reward and future planning. For people who grew up in poverty, those programmed biases can be extremely challenging to overcome and limit their upward mobility. There's also the aphorism that it's "expensive to be poor." The boots metaphor and all that.
As to building wealth at a good rate, doing that from a state of relative stability vs a state of relative poverty are two entirely different scopes. "Escaping poverty requires almost 20 years with nothing going wrong." When 5 years of savings can be wiped out by a car repair that means you can't get to your job, you can lose 5 years of progress in one bad event.[2] The problem with that statement is whether it "is possible to live within your means." It can be exceptionally challenging and complicated to live within your means while impoverished but still move upwards and respond to emergencies and disasters. And it's doubly much to ask that kind of complex planning from someone affected by the deleterious cognitive effects of poverty documented above.
[0]http://behavioralscientist.org/can-neuroscientists-help-us-u... [1]https://blogs.scientificamerican.com/sa-visual/this-is-your-... [1]https://www.theatlantic.com/business/archive/2017/04/economi...