Excellent reply and I apologize for not having time to give you an equally thorough response at this time as I’m slammed. It’s such a worthy reply I apologize.
But the question I would ask you is whether you are any barrier to simply scaling up the tokens on the existing technology? I don’t. I see us at the beginning of a ladder where the only input is capacity just like when Intel was young.
While breakthroughs can change the path, the truth is we have a fairly predictable step-by-step to much more capable systems without one just by scaling the size of the hardware.
Consider this argument:
1) I mean at core the crux of our learning is that predicting the next word may be what human thinking is generally about, and how our brain works, because that’s largely the innovation here.
2) Becoming better at doing that is entirely predictable and we can scale profoundly from current levels with hardware that we are putting into production right now and that we have already invented.
3) Therefore the path to next generation capabilities is relatively (and that’s important I admit) linear.
So prior to breakthrough, we have a simple path forward to what would be at peast fairly advanced capabilities of language and media prediction and manipulation.
Now your argument about progress is right. Predicting material progress of technology breakthroughs tends to be unpredictable and inherently dangerous, but we are in an accelerating trend and most of the time (big statement here, right?) the appearance of an acceleration trend tends to extend to continuance of the trend in a certain timeframe. At least that’s been the case with the “waves” of technology breakthrough since the Industrial Revolution according. I mean to invoke Smihula's theory of waves in this argument, since I know you’ll understand that.
Those last two arguments are statistically supported and quite logical. How smart does it need to be and how statistically probable are excellent points.
As an aside…
For me, one of the areas I am focused on and thinking about a lot is self-organizing AI agents.
Having worked a lot with large scale networks, agents and task specialized networked AI systems get me excited. My brain considers it a blue ocean opportunity.
The parallels between human civilization density and current learning about density of population in demographics driving essential human progress makes me believe there will be parallels in AI. The more, the more they will self organize into network effects, and the outcome of this, like human civilization, will be high quality and rapid progress. I am not a believer in one gigantic AI, but networks of networks self organized in a way where they self-optimize around goals and outcomes, and we are really just at the beginning of exploring this direction of the technology.
The biggest limiting factor to AI technology at this point is human input and the need for human oversight.
While that oversight is definitely necessary, once AI becomes self organizing and self-creating, progress should be profound.
Anyone who doesn’t think that’s going to happen needs to understand the nature of intelligence and realize it’s just a matter of time. You can’t go down this path in a meaningful way and repress only certain aspects of digital intelligence in the long term.