Hacker News Reader

>Talking to the ARC folks tonight, it sounds like there will be an ARC-4,5,6,etc. I mean of course there will be.

Quintessential goal post moving...

If you read the charter of the eval (or any eval, really), this statement is pretty silly.

The whole point of each eval version is to identify a chunk of challenges that humans do well that AI can't. When AI gets to ~80, you move to the next chunk. When you run out of challenges, you have AGI.

HN occasionally devolves into “supremely pedantic and nitpicky” mode. Today is one of those days.

Except you will never run out of challenges and my sense from Chollet has been that every challenge was hinted at being the final one where once beaten AGI would have been created and of course at the end of each one he comes out saying akshuallyyyy this isn't AGI and it wont be AGI until ARC Challenge+1 is beaten!

Reply on news.ycombinator.com