But the reality is that experts' probabilities for human extinctions vary wildly, with the lab leaders at 20%-30% and these researchers at >10% (he didn't state how much higher...), LeCun at <0.01% and the other two godfathers of AI, Bengio and Hinton at >10%.
And this decision to take our shot is not taken in a democratic way by humanity as a whole, but by a few companies racing as fast as possible.
So as long as no one can put an upper bound on the extinction risk, development must be globally shut down.
Because I'm seeing mainly hacker attacks, job insecurity, environmental impacts and vague threats with smiling faces.
Both technologies I believe are the grim reapers of Big Oil. Once Big Oil falls (and petrostates), then we can see environmental recovery begin.
If anything, LLMs siphoning GPUs make doing this research harder as they're not available.