we have the tools to prevent that already: if your computer hacks someone else's, you are a criminal.
Given the content of his recent interview with Ezra Klein, I wonder if we're going to see Hugging Face press charges against OpenAI. When the acquisition was publicly announced, I thought that a significant reason for the acquisition was to hush them up, but now I'm not so sure.
AI safety solved: driving humankind to extinction is now illegal! Skynet is outlawed! Rejoice!