Hacker News Reader

The medium and small players are literally just distilling the larger models.

It's not the smaller players spending billions on training data.

No, the medium and small players are the Mistals, DeepSeek and H Company of the world, with their own models using quirky optimisation techniques to be able to compete.

Reply on news.ycombinator.com