This is happening now because of hugging face attack and Anthropic researchers coming out publicly saying they think there's a significant chance AI will wipe out humanity within a decade. It's happening precisely because progress is happening too fast and frontier labs are starting to lose control.