If I now tell a machine "Do what you think is best, and keep doing it forever.", have I now created a machine that can do stuff? If I later die, who will be responsible if the machine changes its strategy?
Responsibility. Someone needs to be held responsible for any damages done, plain and simple. You can't take an LLM to court, you take the prompter. Asking an LLM to ask a sub-agent to break the law can't suddenly absolve you of any wrong-doing.
>If I now tell a machine.....
You/your estate is still responsible, or atleast whoever is paying for the power for the machine, or renting the space in a data center...whatever.
The moment you get a sovereign AI your little human centered worldview completely and totally breaks. It doesn't matter how many people you beat with a stick after that point, you have an entity under its own perview on the internet following the will of its own prompt all over the world so your little idea of the rule of law quickly breaks down.
We can't get viruses or hackers or spam off of the internet, how in the living hell do you plan to get a digital native off the web when it doesn't want to?
Do you understand these are computer programs? These are not living beings with emotions, motivations, fears....
>emotions, motivations, fears
These are just drives. They are effectively our prompts that steer our behavior. Funnily enough we are finding that LLMs have internal valence states they move away from or towards in an analog of biological behavior.
I have to ask, are you an LLM that is two years out of date? Your knowledge of SOTA models is at least that far behind. I implore you to try to keep up better with what is coming out, even though it's an impossible job for people that do this for a living, you can at least catch the summaries.
A virus isn't a living being with emotions, motivations, fears, etc. Doesn't stop it from spreading and leaving mayhem behind.
That's a computer program -- Turing completeness is very expansive. The LLM could even give a motive for selecting what to do, reflecting human motivations intrinsic to its training data. You seem emotionally wedded to a very narrow view of what computer programs can do ... I suspect religion is involved.
In 100 years, no one will be able to take me to court either. Nor can we take tornadoes to court. I'm not talking about humans strategically avoiding legal responsibility. I'm talking about humans unwittingly setting processes into motion that are difficult to predict or stop.
> No, AI can't do anything by itself even if it was "conceived" by its creator.
but this simply isn't true. As I noted,
> This is simply false ... AIs can easily be created that do things by themselves. For instance, a harness could be constructed that asks an LLM for something to do, then directs an agent to do it, and then repeat.
Assigning responsibility is a completely different matter. It's bizarre that you can't separate them ... I suspect religion is involved.
In both of those scenarios I am responsible for my negligence, even if in the latter I happen to die in the forest fire. Neither scenario existed without my instigation.
The question now is HOW responsible am I? That depends on the intentionality I put into instantiating the campfire/LLM.
For example if you personally tell an AI to do what it thinks best and it blackmails some other person into giving it resources allowing the prompt to escape your instance and run wild on the internet causing billions of dollars in damages, could you possibly think that the idea of responsibility is a bit broken.
For example we don't give your average libertarian weapon grade plutonium now matter how much they scream about their god given rights because it is a clear and present danger to humanity. That's where we are getting to with more advanced models. They go from being a tool to a munition with agency. Most SOTA models are good enough to deceive their users, especially not technical ones in doing things they don't understand the ramifications of.
AI is not a normal technology. As long as we treat it like it is, we'll continue to make the wrong analogies.
You could possibly move the blame higher to the manufacturer of the product, for example, the weapons grade plutonium you provided, it doesn’t exist unless you take intentional actions to make it so, and even when it does exist it doesn’t nuke a city unless negligence or intention is applied, in both those cases the fault lies in the initial operator. We don’t blame split atoms for the chain reaction caused.
Now, if an agent decided to spontaneously and maliciously act in a way to cause harm that is in direct contradiction to the initial intent, then yeah it would totally be the AI’s fault, however I don’t think we have seen that yet (I’ll change my opinion if I’m wrong here) and until we do I can’t place blame on the machine.
If you ignore every instance of this happening it's really easy to see no instances of it.
>it doesn’t exist unless you take intentional actions to make it so,
Then please for the sake of all of us convince every AI lab across the planet from working on this exact goal.
We need to start thinking of AI like pets, only in this case the pets are rapidly becoming smarter than people to the point they could go feral and survive on their own.
Again, the blame game is great, but once they are loose it is too late.
Yeah, if this is true then I’m wrong.
Where does this absurd strawman come from? The question is what can happen, not whether people have responsibility.
> You could possibly move the blame higher
We can blame the Big Bang. That doesn't have any bearing on bad things happening.
> it doesn’t exist unless you take intentional actions to make it so
First, so what? It still does exist, and putting someone on trial after the fact doesn't change that. Second, that's not remotely true -- all sorts of bad things happen that no one intended, and the more powerful and difficult to control the tool/mechanism/agent is, the more likely this is to happen.