All concerns balance against competing concerns, and in this case freedom of computing and knowledge wins over safety. Especially since it’s trivial to copy and share open models.
People did use global agreements and regulation to fix the ozone hole, though, so I think there’s a chance.
I predict that the AI scaremongering will fizzle out when the bubble bursts. There will still be die-hard believers but the public will lose interest.
I don’t see how a stock market crash will make AI-related concerns go away. There was a dot-com crash but the Internet just kept getting bigger and causing more problems. In many ways security has improved, but we worry more than ever about social media, etc.
For Internet-related disasters where people died, see [1].
I would bet that there will be AI-related disasters. Arguably the US bombing a school in Iran counts, though it seems to be due to organizational issues, too.
[1] https://chatgpt.com/s/t_6abd4e3226b48191a26a0fe6768c722f