It’s the story of how open AI and Anthropic were founded: “AI is probably going to destroy humanity, so we must be the ones to develop it because we’ll do it safely”.
Edit: Which makes their “someone hold us back!” calls even more ironic.
If you don't develop killer AI then no one will legislate against it and someone else will create it and do evil.
If you create killer AI you can try to instigate legislation, but the legislators may not agree to help.
Necessity is the mother of invention, or you know, all of our laws and regulations.