'Godfather of AI' Geoffrey Hinton says it could drive humans extinct in 10 years
telegraph.co.uk
telegraph.co.uk
Giant Meteor keeps letting me down.
> Prof Hinton has previously predicted there was a 10 per cent chance AI could lead to the downfall of humankind within three decades.
How can anyone take something like that seriously? Do you even bother to ask yourself how he could possibly know that?
"Humanity is a just a small step in the giant staircase of intelligence" - Geoffrey Hinton
From the ARC announcement: "a large ensemble of low-compute Kaggle solutions can now score 81% on the private eval." If I understand this correctly, o3's performance is not a grand leap beyond the capabilities of many times cheaper models with similarly privileged information. The ARC news seems more likely to be evidence that the benchmark needs tweaking than proof that scaling works (although OpenAI's marketing team would like us very much to interpret it as the latter).
There has also been a bit of imprecision and hand waving around other benchmarks that bolsters my skepticism. For instance the Codeforces benchmark results were touted with no meaningful description of the methodology and what little we do know suggests (to me, at least) that comparing o3's elo to that of a human is an apples to oranges comparison: https://codeforces.com/blog/entry/137539
In my (possibly flawed) interpretation: o3's scores appear to be an achievement because they were attained by a single model, but the benchmark itself needs refinement before it can claim to be a measure of AGI like it set out to be, as one can bruteforce their way to similar results.