Hacker News Reader

Model collapse

If you solve it then yes humans are toast mental usefulness wise

Model collapse as an insurmountable wall is a fiction dreamed up by Luddites, actual frontier labs understand the failure mode and avoid it.

Nobody can avoid it. You can RL things in a box until the box is mapped perfectly but that doesn't mean you can go forever on out of distribution data. Our number of boxes will increase but model collapse is an open problem.

Astra goes farther than any model before but it cannot go forever.

Models have been trained on synthetic inputs for over a year now. Collapse only happens in very specific circumstances, it's not a limit in practice.

Yeah, that's why fully autonomous robots are so easy to train on novel tasks. Or why figure is strapping cameras to human workers for cleaning.

Sythetic data works in a bounded box we have mapped you can't just make up novel data and it works.

Model collapse is completely unsolved.

Reply on news.ycombinator.com