Okay what happens when an AI agent hacks a children’s hospital and turns off the all the ventilators? “Lol whoops”?
What about power infrastructure?
There’s uncountably many ways to cause severe economic (and public welfare!) damage with malicious code generated irresponsibly with language models.