What might come back as useful tool? Authorship. People actually signing the content and putting their reputation on the line. It still exists obviously (journalism…) but it might need to be standardized and industrialized.
"So crap filtering became important. Businesses were built around it. ... " Generating crap "didn't really take off until the military got interested" in a program called "Artificial Inanity".
The defenses that were developed back then now "work so well that, most of the time, the users of the Reticulum don't know it's there. Just as you are not aware of the millions of germs trying and failing to attack your body every moment of every day."
A group of people (the "Ita") developed techniques for a parallel reticulum in which they could keep information they had determined to be reliable. When there was news on the reticulum, they might take a couple of days to do sanity-checking or fact-checking. I'm guessing there would need to be reputation monitoring and cryptographic signatures to maintain the integrity of their alternate web.
That's only the first step in the degradation. In a worse case scenario, where AI-generated crap is not contained, imagine this: young and still immature humans "learning" their styles of writing, information, and social expectations from content generated by AI that itself trained on AI-generated content─and then more AI trains on content generated by these humans that were trained on AI-generated content. And on, and on, and on...
We should ask questions like "Can countless AI's fracture society into a million sub societies disconnected from the reality around them".
(I'm not always as doom-and-gloom as it may seem, I'm just in a pessimistic mood today for some reason)
This has about as much chance of working as the evil bit.
That, and removing the financial incentives to attract traffic AKA ads.
"Fall, or dodge in heaven" by Neal Stephenson actually touches on this topic quite a bit and comes to a similar conclusion. Not his most accessible work but I enjoyed it. That book was written just before Trump won 2016 elections and in hind sight making that book really spot on and timely.
In the book, different streams of truth become so hard to separate due to all the spam, automated content, etc. that people start filtering it based on reputation and signatures. The game then becomes curating and filtering the content, which is ultimately not an objective thing but a subjective thing. So the net result is what we are actually starting to see today which is different groups of people locked in their own bubbles and no longer even getting exposed to the other side's point of view or even able to agree on some basic facts. Like who actually won the election. And people are feeding those bubbles with nonsense to influence opinions, get people to vote certain ways, or simply to just create chaos and fear.
In the book the topic is not an election but the seemingly simple question of whether or not a certain town in the us still exists after it was supposedly blown up with a nuclear bomb. In the book, this event leads to people acting as if that happened and ignoring all evidence to the contrary pointing out that in fact this was an elaborate hoax designed to create a massive panic.
That particular dystopian outcome is not necessarily what would happen. But using technology to authenticate where content actually comes from along with some reputation mechanism would go a long way separating the noise from the genuine content. It's simple and easy to do. So, why don't we?