I mean it in the way an Arduino knows a gas leak is happening. I similarly like the Arduino, I know about my persona that I perform. I'm not anthropomorphizing the Arduino. If anything, I'm mechamorphizing me.
ChatGPT knows about the ChatGPT persona. Much like I know the persona I play in society and at home. I don't know what the "core" me is like at all. I don't have access to it. It seems like a void. A weird eye. No character, no opinions.
It's not unreasonable to conclude that humans work the same way. Our language manipulation skills might have the same flaw. Easily tipped from one confabulation to another. The subjective experience is hard to put into words, since much of our experience isn't tied to "syllable tokenization".
Why not putting it earlier than that. Why not starting and running it's own LLC. I would think when that LLC is bigger than Google it might already be obvious.
Maybe this won't be. How long do you think a machine will be able to outdo any human in any given domain? I personally think it will be after they are able to rewrite their own code. You?
You think too poorly of OP. I won't insult his intelligence by claiming he can't to a 5 second Google search before posting. He got the quote verbatim. Clearly he searched.
LLMs are also not understood. I mean we built and trained them. But don't of the abilities at still surprising to researchers. We have yet to map these machines.
Humans use soul juice to connect to the understandome. Machines can't connect to the understandome because of Gödels incompleteness, they can only make relationships between tokens. Not map them to reality like we can via magic.