I wrote “I am alive” on a piece of paper, and placed it into a photocopier. What I saw next has shocking implications (science.org)
The power of wishful thinking is too strong. "Today's AI can't be conscious because I don't want it to be."
Most sci-fi AIs are way beyond our current models. I’ve yet to see one that would actually pass a Turing test (that said, I’ve not tried models that were post trained to actually try to behave like a human).
Consciousness itself is a term that is not really defined anyway, so depending on each’s take the answer will be different.
The people you cite want to believe, and so are effectively the opposite.
Of course, you probably already knew this and have had it explained to you multiple times and are choosing to ignore this detail, but possible that someone else reading this might interpret what you wrote as a cogent argument.
LLMs do sound human, I’m not contesting that. But if pressed they will not react as humans. There is an infinite amount of questions that an LLM will answer for which a human would give you a blank stare, told you to shove it or call the police.
It helps that I also learned about ESP, EST, NLP, short cons, long cons, Scientology, horses, cults, religions, wars, treachery, fanaticism, magic, magick, physics, scams, hypnosis, self-hypnosis, delusion, and economics.
ESP fooled lots of people who were expecting frauds but had no experience in experimental design, or who were not expecting frauds and did not control for them.
You can blame MS for adding a prng in the code. But imagine an LLM that check from time to time the price of electricity and GPU available and decide to change the internal mode of launch activities in a TODO list, or use spare capacity to generate a random tunes that you like to hear while prompting.
There was a time when this same assumption was applied to African Americans.
There is no way Data could conclusively prove to a skeptic that he is conscious (and the show explores this) or indeed that you can prove to me that you are. It's also impossible for me to define consciousness. However, I know absolutely that I am conscious, I am very confident that you are too (unless I'm replying to a bot), along with many animals, and I am confident to a level somewhere in between those two that neither ChatGPT nor my trousers are conscious*. Taken together these statements don't contain any contradictions (although it is certainly possible to hold other, equally internally consistent, views).
How can this be? It's because of the nature of consciousness and how it relates to knowledge and language. I know I am conscious with a higher degree of certainty than I know anything else because conscious experience is how I know anything else, up to and including that I exist (cogito ergo sum). For all I know every experience I have might be a trick. I might be a brain floating in a tank wired up to the Matrix, but even if so I am conscious.
And one of the things I consciously experience is the relationship between consciousness itself and language in my mind. What I see is that language is smaller than, secondary to and somehow contained by consciousness. I consciously experience language but also consciously experience much more than that, things that cannot be conveyed with language. Most of my experiences are such that I could perhaps evoke them in your mind by likening them to other, shared experiences, but that I could never concretely capture them in language and unambiguously communicate them. I know that because I experience those things and I experience language and I can perceive, directly, the categorical distinction between them.
To ask me to "define" or "prove" consciousness, then, is to ask me to capture in language the most extreme example of this categorical distinction. It's asking me to encapsulate in language not just one of the vast array of everyday experiences I have that cannot be so captured, but the entire thing, experience itself. It's just not possible.
But the fact I can't do this doesn't then imply that I don't know anything about consciousness and have no basis on which to hold a view such as "LLMs are not conscious". Indeed the reason I know I can't define consciousness is that I can perceive it and see that I can't. That same perception of and familiarity with consciousness is what enables me to make the judgements above about humans, animals, algorithms and items of clothing.
You can of course perfectly reasonably disagree with my judgements on those things, but I hope the above makes it clear that the fact that I can't define or prove consciousness doesn't imply that I have no basis on which to make them. There is no "gotcha" in these challenges.
* I have no view on Data's consciousness as he is fictional.
Exclusive!