I think people who make being smart their whole identity are a out to use AI to turn the rest of the population into indentured servants.

The comparison between ELIZA and LLMs is valid you boil it down to "humans evolved for 6-7 million years, had spoken language for 500k years, but have only had something non-human that could generate convincingly novel language well enough to hold a conversation for a few decades".

There's no inherent reason it can't turn out having a non-human generate convincing enough language for conversation isn't a complete evolutionary blindspot the same way the short form feed has pretty much one-shotted society...

LLM chatbots are software designed to manipulate, addict, and mine data. Just like social media before it. But anyone who bothers to read the output in a domain they understand will discover they aren't all that no matter who OpenAI steals research from.