I'm confused.

Surely ChatGPT, etc have been trained on content from these very same SEO optimisation hellholes you're talking about if it was trained by scraping the web?

Is there some trick that allows it to determine whether the content it's being trained on is SEO garbage?

Maybe I'm missing something here, but it seems like all you're getting is an amalgam of SEO content feed to you by a bot...