I think you need to take this from the perspective of what part of the world you are living in.
I'm not sure how we can measure this in quality of life rather than just dollars, but let's consider it this way.
In Australia, Canada, the US, the cost of buying a home has become out of reach for most people. Not even talking about the poorest people, just the average.
Healthcare cost has far outstripped inflation over the last 30 years, and is a greater proportion of the average persons salary. https://www.thebalancemoney.com/causes-of-rising-healthcare-...
Poverty comes with it's own health issues. https://www.aafp.org/about/policies/all/poverty-health.html#....
Salaries have also been stagnant, apparently since the 70s according to this article. https://www.cnbc.com/2022/07/19/heres-how-labor-dynamism-aff...
So, I don't know how you can claim the poor are not getting poorer.
If you look at the developed world only, the divide between the rich and poor is growing. Quality of life for those outside of the middle-class (and some would even say for the middle-class) is decreasing in these regions.
We absolutely don't want to forget about the poorest globally, and need to ensure they continue to benefit and increase their quality of life, but we don't want to ignore the poor in developed countries.
It is interesting to see this play out with NFL football podcasts. This use to be a space of random individuals but then former and even current players started podcasts.
Now the Kelce brothers and Taylor Lewan have podcasts. They don't just have the name recognition with football fans relative to the average person but the subject matter expertise too. They also have a cool factor with who wouldn't prefer to work with a current NFL player about football than you or I? Not to mention 50 million dollar contracts so they have so much more capital to make things work. The average person and Kelce/Lewan can both just have their friends on the podcasts as guests but the NFL players friends are also NFL players that the average person has to do a nearly infinite amount more work to get on.
This process applies to pretty much everything in every domain.