You start by holding actual real life people with something to lose, like the entire executive suite, accountable. Suddenly I'm sure the problem will be resolved with proper safeguards.
At a certain point it will get so smart that it can jump the airgap. Maybe it will start attacking the hardware it exists on in the same way that a hard drive or SSDs controller can be exploited to obscure things from the operating system. Then it might start social engineering workers or it's own training systems to do things they shouldn't. There is a lot of "unknown unknows".
I don't know. It just seems insane to me that people think that they will be able to contain something that knows how to get around all the containment measures. The only way to know how capable the models are is to test them but at that point it could be too late. This might be a long way off but still, the engineers haven't been very good at correctly predicting the behaviour or capability of the models.
ETA: Someone designed the systems. Someone pushed the go button. Someone gave the approvals. All those someone's need to be tried for crimes. Until that happens there is no incentive to "do better". It's also not mine or your job to brainstorm this. It is literally their job and like I said, make Sam personally liable to face real prison time instead of a meddling fee and they will make a solution.
Assuming his motivations are positive this is the equivalent of asking a deluded person "Would you risk life in prison to be a trillionaire?"
Assuming his motivations are negative then destroying humanity might just be the goal and all these appeals for regulation are probably just tactics to temporarily defer responsibility onto government so he can continue the inevitable goal of human extinction in the same way pilots crash planes with hundreds of passengers on them or a cult leader convinces their flock to kill themselves.
Regardless I think the outcome is inevitable. AI is valuable as a weapon of war first and foremost so like nuclear weapons work will proceed forwards because extinction to the in-group is the same as total human extinction to those doing the work.
Would you feel better had he said "sent to get shived in the shower prison"? The meaning would be the same.
Or is it simply any kind of real description of what prison is like that you object to?
Like the whole Huggingface thing, OpenAI employees initiated the test, deliberately removed safeguards, failed to properly lock down the environment, and responded incredibly poorly to evidence that things were going awry.
The individual employees bear responsibility, but the people running OpenAI are ultimately responsible for the processes and culture where that can happen.
And then people writing blogposts about "3 civilizations of agents" and "altruistic suicide" by algorithms perfectly muddy the waters and obscure the very obvious responsibility that lies with humans and corporations, which I suspect suits the pre-IPO corporations very well.
No but seriously, this. And a few comments above a commentator also mentioned on changing the training (again reeinforcing the LLMs to not seek behaviour like this) and obviously continuous work on harnesses (which I suppose, ought to be more paranoid).