I worked for a company in the SEO space a bit over a decade ago, initially to try and learn the things you call out above. My surprise at the time was to discover most of the snake oil being sold as “SEO” was nothing more than basic usability 101 stuff. Make sure titles are descriptive. Try to use terms that your readers would use and recognise to ensure the content resonates. Structure your content in a sensible way with clear headings. It’s almost like Google were trying to turn a human experience into an algorithm! ;) There was obviously a bunch of black hat stuff too but the efficacy of that was generally pretty short lived and the techniques tightly held. The whole SEO industry seemed to be in on the joke that you only spoke about those techniques or provided training on them after they stopped working.

Something seems to have changed since that time though. I don’t think it’s Ahrefs because there were similar services long before them. Did Google lose their way and stop trying to quantify a human experience? I had my concerns back then when they introduced the concept of a canonical URL for duplicate content, something that’s implemented in a way to only be useful for a bot and not a person. But I’ve been too distant to these things to know if it was an isolated example or the beginning of a trend. Did the cat and mouse game of improving usability come to a plateau and now we’re in the inevitable end game of exploiting edge cases and 2% improvements? Is this what should have been the completely predictable state we’d end up given the alignment of incentives? Search results that are _just_ good enough so that you don’t abandon Google, but not so good that you click a result instead of an ad.

I don’t know what the cause is, or if it’s even just one thing. But it definitely feels like it’s been getting progressively worse for a long time and that the rate of decline has been accelerating.

To that end I’ve personally switched to Kagi. It’s at least ticked the “just good enough” box for me for a few months, which is something that never stuck with DDG. And so I fronted the cash for an annual subscription incase the incentive system with Google was part of the problem. I figure me moaning about it while still active using it means I’m complicit in being part of the problem too. And so I should vote with both my feet and dollars in support of any team that’s actually trying to fix things.