Hacker News Reader

Comment by paxys | Hacker News Reader

While I agree with the spirit of the competition, a $1M prize seems a little too low considering tens of billions of dollars have already been invested in the race to AGI, and we will see many times that put into the space in the coming years. The impact of AGI will be measured in trillions at minimum. So what you are ultimately rewarding isn't AGI research but fine tuning the newest public LLM release to best meet the parameters of the test.

I'd also urge you to use a different platform for communicating with the public because x.com links are now inaccessible without creating an account.

View on HN

I agree, $1M is ~trivial in AI. The primary goal with the prize is to raise public awareness about how close (or far today) we are from AGI: https://arcprize.org/leaderboard and we hope that understanding will shift more would-be AI researchers to working new ideas

That was my initial reaction too.

"Endow circuitry with consciousness and win a gift certificate for Denny's (may not be used in conjunction with other specials)"

The $1M ARC prize is advertising, just like being #1 on the huggingface leaderboard. It won't matter for end consumers, but for attracting the best talent it could be valuable.

They thought of that and so have yearly $100,000 in yearly prizes for the best results as well, so things can build up towards someone winning the $1 million over time: the yearly prizes require you to publish the techniques.

The leaderboard is on the website. What medium should they use? https://arcprize.org/leaderboard

The submissions can't use the internet. And I imagine can't be too huge - so you can't use "newest public LLMs" on this task.

That is correct for ARC Prize: limited Kaggle compute (to target efficiency) and no internet (to reduce cheating).

We are also trialing a secondary leaderboard called ARC-AGI-Pub that imposes no limits or constraints. Not part of the prize today but could be in the future: https://arcprize.org/leaderboard

Using the internet would leak the test data, a big problem with ML benchmarks, and also allow communication with humans during the test.

Yeah, I also immediately had Dr. Evil narrating the prize money amount in my head once I saw it.

AGI will take much more than that to build, and once you have it, if all you can monetize it for is a million dollars, you must be doing something extremely wrong.

Yeah, in 2006 Netflix offered $1M in a similar scheme. At least back then that sum meant something.

Reply on news.ycombinator.com