Of course. Even in an all-out nuclear war, the probability of human extinction is close to zero.
Killing even 10% of humanity should be unacceptable, can't believe this argument is even happening
The actual established real evidence is that this tech is showing unprecedented capabilities (including destructive) and its safety guardrails are lacking.