Hacker News Reader

You can generate 1.0 programs with 3.0 programs. But can you generate 2.0 programs the same way?

2.0 programs (model weights) are created by running 1.0 programs (training runs).

I don't think it's currently possible to ask a model to generate the weights for a model.

But you can generate synthetic data using a 3.0 program to train a smaller, faster, cheaper-to-run 2.0 program.