Don’t cars and ropes and drills occasionally kill people too? Society seems to have accepted that fact long ago.
Somehow we expect the digital world to be devoid of risks.
Cryptography that only the good guys can crack is another example of this mindset.
Now I’m not saying ClosedAI look good on this, their safety layer clearly failed and the sycophantic BS did not help.
But I reckon this kind of failure more will always exist in LLMs. Society will have to learn this just like we learned cars are dangerous.