>"people go batshit too."
Thank you for this observation.
LLM Learning from LLM -> Drift
Human on Human echo chamber -> batshit crazy.
I've often thought human echo chambers were their own phenomena. Something about the brain and tribalism from evolution.
I never thought of it in terms of AI training data.
As LLMs train on data produced by other LLMs, they will drift.
And this drifting is the same phenomena as when humans get in an echo chamber. If each person hears what the others are saying, and spits it out in some form, and the others hear it, and also spit it back out in some form, this turns into a drifting in understanding just like an LLM. ("idea telephone game")
Technically, it isn't just in echo chambers. It is all humans, at a lot of different scales, from small to large groups. Countries, and cultures are echo chambers at larger scales.
Like how the concepts in philosophy, as they become more abstract, they kind of twist back on themselves, and become re-invented. And as they get more abstract get accused of just 'playing with words'. Just like an LLM can just 'play with words'?
The difference is eventually humans have to relate to 'real objects'.
So even if the word for 'apple' drifts over time and between groups, eventually you can still relate the words back to the real 'apple'.
Humans are grounded in the reality of 'objects' in space.
But. I tend to think this is temporary. As LLM's are linked to things like AlphaGo, and drone flight systems. They will also have to deal with real 'objects'. Maybe that will then lead to more grounded reasoning.