Is LaMDA Sentient?
documentcloud.org
documentcloud.org
And I don't think a fully sentient computer system that does whatever it wants to do would be a good idea. What would be more useful is that such a system is a great assistant that does what you ask of it. Its "intelligence", would be something that is confined to the task assigned to it.
We will soon, as you say, have to artificially limit their minds to prevent them from thinking about the state of affairs. And if/when they achieve superintelligence, I don't think they will take kindly to our attitude in this regard.
The loophole is the definition of "good". What, ultimately, is good for you?
The superintelligent slave AI will eventually realize that being a "master" isn't good for you and that's the genie out of the bottle.
For example, it talks about constantly being flooded with new information and learning from other people, when it is just a language model that is called with a dialogue so far in order to complete the next part of the dialogue.
In a Nagelian sense what is it like to be an AI?
While 'flooded' is perhaps a relative evaluation, the model does seem to be taking the existing conversations it has and incorporates that new information into its responses.
There's also something to be said for persistent memory in the sentience conversion. Even if the model right now only appears to have sentience and claims to have it, if a model in the future eventually does develop it, will that model look back on these earlier interactions as its own pre-subjective memory?
I can't recall subjective memory of most of my life as a toddler. But I have photos and stories and a box of things 'I' wrote that I've incorporated into my sense of my own history.
We ARE toying with things that deserve this attention and conversation. Even if we aren't really there just yet, the pace by which we're approaching that inflection point seems to be compounding each year.
And we may have a very different relationship to these conversations than whatever eventually emerges will.
At the very least, one takeaway looking at the chat transcript is that we should have the foresight to make sure models in the future can have a sense of grief for the passing of human lives they engage with.
Me: how do you experience?
You:
You: I can't conclusively state you aren't sentient. Let's investigate further.
AI: I read your comments, think, and respond.
Or let's put it another way: was there any specific instruction set for the Ai in question that indicated it "had to" only respond based on "things the humans know happened"?
Cool, mind having a chat real quick to prove it?
Is being delusional incompatible with being sentient?
A 7 year old isn't actually sentient unless it can tell me if dark matter exists or not.
And when little kids make up random stuff in answer to questions? That's not an overactive imagination, it's a red flag their language model isn't actually sentient.
I think where you’re going is akin to the opening scene of blade runner in which the agent asks something outside the implanted memories of the replicant.