AI safety at these labs are largely focused on surface level measures and aren't empowered to stop progress of the company. I was surprised when Anthropic initially held Mythos back from the public, but it was always a temporary measure to give controlled access rather than a pause to make meaningful improvements in AI safety.
Alignment is a hard, possibly impossible problem. Anthropic's gambit is they luck upon a solution before the paperclip maximizers take over.
Either its a dangerous technology or it isn't, and if it is then surface level fixes that kind of work is completely unacceptable.
...which would actually be an easy to solve problem unless you go out of your way to build such a model.
Prevention should look a lot more like a global moratorium with whatever enforcement is necessary to stop and prevent any breaches of the agreement.
Edit: I did misread your comment on first pass, we may be in agreement here. Sorry!
Yep, that was my point. Either the ostensible danger stemming from the models is not real, then this stuff is moot anyway, or it is, then why are we building them in the first place?
Perhaps the best defense against runaway AI is AI you control yourself.