Hacker News Reader

> That's a bit like saying FOSS is open source only if a copy of the programmers is applied with the code.

Wait, what? You can build the FOSS app entirely from the source. You don’t need a copy of the programmer.

Just as you say, you do not need Llama's training data in order to build Llama from source, nor even to fine tune it. You don't need a copy of the training data.

(edit to spell Llama correctly)

No, you need llama's binary, you can;t know what its trained on because thats a secret or at least obfuscated.

The currently LLM status is more akin to opensource plugins to some propriety system, like game modding.

You can fine tune it, which gets you far, don't get me wrong. But you cannot study how major model changes to Llama or changes during the training process behave when you apply those changes from scratch.

Reply on news.ycombinator.com