This is really dumb.

Deepseek showing that you can do pure online RL for LLMs means we now have a clear path to just keep throwing more compute at the problem! If anything we made the whole "we are hitting a data wall" problem even smaller.

Additionally, its yet another proof point that scaling inference compute is a way forward. Models that think for hours or days are the future.

As we move further into the regime of long sequence inference, compute scales by the square of the sequence length.

The lesson here was not "training is going to be cheaper than we thought". It's "we must construct additional pylons uhhh _PUs"

Markets remain irrational and all that...