Is AGI really inevitable ? Claiming something is inevitable is a great way to disarm critical thinking.
In the context of AGI, is it inevitable eventually? Sure, I would agree, unless some catastrophic event puts back our technological advancement.
IMO, don't see the path to AGI with the current tech, though. All current SOTA agents are still LLM based with all their flaws (limited reasoning, generalization, incomplete world model, hallucinations, ...). At their core, they are still next token predictors with a limited context.
Most of the advances in AI in the past 2 years are in post-training and harnesses.
I'd expect a different core technology than just an LLM in order to get to AGI.
What if it’s not a catastrophic event, but technological progress just asymptotically approaches 0? What if there is a limit to layers upon layers of abstraction and at some point it just becomes too complicated to keep going?
What if we all somehow decide that we don’t want AGI? It seems impossible now but a lot of people really seem to hate AI. What if that sentiment grows globally the next 50-100 years?
That’s all ignoring the possibility that the materialists are wrong. Around 80% of the world believes in some kind of soul or spirit. If anything materialism is a bit of a fringe belief.
It’s true that if AGI is easy for a small group of people to build prohibition isn’t really possible. But if AGI takes a massive data center and billions of dollars, it could be.
I doubt it. Why do you believe it's possible?
> You make a grand claim when you think that in 50 years that 'all forms of AI is bad' will become an equally globally-recognized sentiment as 'all forms of unjustified killing is bad'.
No I don’t. You need to go back and reread.
Looking at history, there is not really an argument for progress to stop in the long term. I think I get what you mean, that further advancement gets more and more complicated and the human mind gets to a limit what it can comprehend and reason about. But lots of research and progress have been augmented by technology in the past 70 years or so, and I don't see a reason why it wont continue along that path. I agree that there is a limit to everything. But it is almost impossible to forsee when and where that is going to happen.
That’s my point. We have no reason to assume that AGI exists within that limit. Certainly not enough to confidently state that it’s inevitable.
> I think I get what you mean, that further advancement gets more and more complicated and the human mind gets to a limit what it can comprehend and reason about.
That’s exactly what I meant!
>But lots of research and progress have been augmented by technology in the past 70 years or so, and I don't see a reason why it wont continue along that path
I agree that we’ve probably got a long way to go.
Before the recent floodgates cracked open, AI research made only slow incremental progress for decades. Why couldn't we already be back near that rate of progress?