Big hosts can survive by essentially offloading support, and making as much as possible self-managed by the end-user.
The non-technical people who just want "a server that works" won't, broadly speaking, pay a premium for that. They're non-technical and will eat up support-hours too, asking questions about setting file permissions on Wordpress.
If everyone just charged some basic $ for support, it would generally get better. I'm perplexed and sometimes shocked how much 'free support' people expect - and often "get" to some degree - by cheap hosts. I'm in some WP support forums on facebook and... man - what people expect for $10/month is crazy. And... the amount of bs misinformation and half-truths being spread by 'experts' in those forums in crazy too.
Add in 'authoritative' sites and experts 'recommending' (via affiliate links) bluehost/godaddy/siteground on a recurring basis, and we've got this... again(?) - race to the bottom?
People will post how 'awesome' the support is because some remote people spent 15 minutes walking them through file permission setup amazes me.
Oh... and "free migrations" between hosts. Then when there's a real issue - like 6 of the 38 plugins don't actually work on the new host, and the new host says "this will be $75 to make it all work" people are outraged! and publicly slam everywhere they can. Then someone else promises unlimited XYZ, they move, and the cycle starts again.
Finally... liar/cheats/scumbags who intentionally rip people off on top of all that (I think some of the ripping off isn't always intentional, just misinformed) makes people even more wary of trusting genuine people.
I may have just described half of the history of human society, unrelated to hosting, but.... I've watch this market grow over the past 20+ years, and it's just so... weird.
Commoditization https://en.wikipedia.org/wiki/Commoditization
Economies of scale https://en.wikipedia.org/wiki/Economies_of_scale
A lemon market is when the buyer doesn't have enough information to tell the difference between a good product (peach) and a bad one (lemon). Since the buyer can't tell the difference, the price he is willing to pay will end up somewhere between the value of the peach (more expensive) and the value of the lemon (cheaper). What happens then is that the sellers of lemons thrive while the the sellers of peaches end up leaving the market. This lowers the average price and creates a cycle where the price decreases which drive even more sellers of quality products to leave the market which lowers the price further...
https://old.reddit.com/r/dredmorbius/comments/69wk8y/the_tyr...
A Gresham's Law dynamic.
Rackspace might have had a chance, but it is gone now..
That is dead and buried now though. There may still be some good people there but their products are dated 'also ran' knockoffs of AWS services and I don't trust them within an inch of our environments anymore.