Okay, so describe to me when and how we’ll detect and mitigate problems as we approach AGI or superintelligence.
The promise of upside grows exactly in lockstep with the danger of downside.
It is absolutely rational to say: “if our AI safety research lab is being hijacked by commercial interests before it’s even commercially viable as a business, then how will we possibly pull the plug on the final descent?”
P.S. neither Yann nor me nor you nor Sam nor Greg know what “real intelligence” is, and we certainly don’t know what superhuman intelligence is just the same way an ant couldn’t possibly know what human intelligence is. It is inconceivable to us — that is the point of intelligence.