Contra George Hotz on "AI 2040 and the Cult of Intelligence"

I always find Superintelligence inevitability interesting. And the author dismisses George Hotz argument about supply chains and the way that in order for ASI to truly take off it has to dominate not just the world of bits but atoms as well.

But I imagine there’s this problem that measuring intelligence in AI is not the same as measuring intelligence in humans. How is fable not already super intelligence. How is it not way smarter than the 99th percentile human? In terms of speed, broad ability and pattern matching behavior. If intelligence is loosely correlated with lifetime income, Anthropic billions in revenue should be a decent measure that LLMs are way smarter than most folks.

Because sometimes I think the inconvenient truth is that when people ask, you don’t think we’ll have AI that’s smarter than humans. It feels to me like we had AI that was smarter than humans a long time ago that somewhere around GPT three or GPT four we had AGI and if we already have AGI and we already have AI that’s smarter than humans then maybe the real question is is intelligence not his intelligence actually the right measurement for what we’re trying to achieve.

Or maybe it’s that ASI inevitability claims to be a very general argument, when it’s a very specific argument (or vice versa)

The AI inevitability argument seems to be something like - are you so anthropocentric and unimaginative that you can’t see a world where human creations outdo humans.

When the specific claim is more like “The specific technology of large language models will hard takeoff in the next few years”

There are infinite years ahead of us. Maybe hard takeoff is coming! And maybe it’s a thousand years away.