There's a somewhat significant group of people that are easily wooed by incorrectly used technical terms. So much so that they are willing to very confidently use the words incorrectly and get offended when you point that out to them.
I think pop-science journalism and media has a lot of the blame here. In the search to make things accessible and entertaining they turned meaningful terms into magic incantations. They further simply lied and exaggerated implications. Those two things made it easy for grifters to sell magic quantum charms to ward off the bad frequencies.
It feels a lot like logical razzle dazzle to me. I bet if I'm on the right neurochemicals it feels amazing.
It's noteworthy that the modern LLM systems lack global long-term memory. They go back to the read-only ground state for each new user session. That provides some safety from corporate embarrassment and quality degradation. But there's no hope of improvement from continued operation.
There is a "Recursive AI" startup.[2] This will apparently come as a Unity (the 3D game engine) add-on, so game NPCs can have some smarts. That should be interesting. It's been done before. Here's a 2023 demo from using Replika and Unreal Engine.[3] The influencer manages to convince the NPCs that they are characters in a simulation, and gets them to talk about that. There's a whole line of AI development in the game industry that doesn't get mentioned much.
[1] https://www.cbsnews.com/news/microsoft-shuts-down-ai-chatbot...