The exponential part may be iffy, but it is self improving.
And this same RL is also creating improvements in small model performance.
So, more LLMs are about to rise in quality.
And this same RL is also creating improvements in small model performance.
So, more LLMs are about to rise in quality.
If yes, then you get exponential increases very trivially. If no, then something external continues to bottleneck progress.