The AI Revolution: The Road to Superintelligence
waitbutwhy.com
waitbutwhy.com
1) Who says that each additional unit of intelligence doesn't need an exponential (or worse) amount of effort? This would mean that the increase in intelligence is very slow, and most importantly, linear or even sub-linear.
2) Maybe we can build an AI that has an IQ (relative to humans) of 100, and that's the best we can do. What if an IQ of 100 isn't enough to improve itself? Then there won't be any recursive self-improvement at all.
These two assumptions are simply taken as given, which I find a little disappointing in an otherwise very good article.