Hacker News Reader

Yes I'd heard the labs (Anthropic mostly) speaking about LLMs training LLMs, so I wanted to make things a little more concrete and test it out myself! Essentially you are correct though, my framework allows the agent access to compute, but also the agent itself is being trained to become better at training models with that compute.

i remeber reading in one of the release blog posts that that version was the "first that codex helped train"

Yes exactly, and also there is auto-research by Karpathy, Fable-5 on parameter golf etc which point to the direction of highly-assisted / autonomous AI training as the future. Wild.

I guess more important than LLMs training LLMs (which is mostly the same code over and over) is LLMs cleaning and curating training data.

Very good point. Sifting through noisy data and creating curated datasets could be of great value. Perhaps worth a project by itself!

Not sure how much of it was marketing but M2.7 supposedly trained itself

https://www.minimax.io/blog/minimax-m27

Very cool! Thank you