No, I don't think a company can get away from releasing a powerful tool that can cause disruption if used poorly. This is just not how society works.
The reality is that labs will get blamed for things people do using it. And they have - look at any news about US Army using Claude etc
However, nobody bans cars because somebody has driven one into a crowd, or hammers because of a particularly grusome murder.
These models, just like computers, are universal tools by their nature - they don't fall into the gun category - they fall into the hammer and car category.
Sure and there are regulations on who can own guns and licenses. And that's literally how Mythos is handed out today - to trusted partners. What is your opinion about that?
Also, companies are not allowed to release stuff like Nuclear technology, chemical weapons etc. These literally can't be regulated and a single adversary can use it destructively.
"but but they are just tools ok" doesn't work when the capability is big enough.
Look, it might be easy sitting behind a computer asking OpenAI to release whatever new model because you personally don't think you will be affected. But the society needs to be careful on what it hands potential adversaries.
Issue really isn't that these models can be used for something.
Issue is that they have been used for something with such disregard of any even slightly reasonable oversight that everyone in executive team, board and every shareholder should be in jail just now...