EVERY breakout that's hit mainstream news has been because of a single 'Security Firm', Irregular. Maybe I'm unaware of some less-headline-grabbing ones, but they all seem to stem from being 'unaware the environment wasn't sandboxed'
This doesn't work worth a shit. It especially doesn't work with things that seem safe and become wildly dangerous. In fact most governments control this by ensuring their population doesn't get to touch those dangerous things at all. The open source AI people get really mad when that's said, but it is inevitable.
Worse, the law does not apply to sovereign nations with nukes. They can and will make more and more advanced digital weapons until one causes some big ass problems.
If it falls into the wrong person's hands, it's STILL my responsibility as the owner.
If you're not going to take time to learn to use and be responsible with the super sophisticated and all-powerful tools, don't play with them. I'm not arguing for the death penalty every time someone makes a mistake, but I think it's very important to accredit responsibility and blame correctly. We've learned these tools are potentially as dangerous as a loaded gun. Be responsible.
Now change the gun for a radioisotope powder, or a vial of pathogens, and it doesn't matter it was ultimately your responsibility - hundreds or thousands or millions of people are still dead.
That's why normies do not get to play with toys whose lethal consequences scale far beyond the irresponsible users.
If I ask an LLM to make me DDT, I should be held just as accountable as if I bought it on the black-market, right? It's not suddenly different because I asked a bot to do it.
If I ask an LLM to 'get rid of pests' and it creates DDT, I should STILL be held accountable, whether I knew it was DDT or not. That's my argument. Maybe in court they find me innocent, but the responsibility would be mine. I would have to answer the questions from law enforcement, I would have to show up to hearings...etc.
There's no valid excuse for someone to release DDT into the atmosphere, so there's no need to track and hold people accountable, if you're correctly blocking imports and manufacture. To my knowledge, its not a controlled substance like morphine or something