Hacker News Reader

Would using llama as the llm teacher for a commercial model mitigate licensing concerns since it's not being used directly but only to create a separate artifacts?

What could impact the ability to discern whether it's llama or open llama? Are there artifacts of a given Llm that could be exposed via distilling process?

View on HN

Not a lawyer, but I think that depends on who's training this model for what purpose? If you're training the second model specifically to be able to use a llama-like model commercially, that's arguably a for-profit use of llama. On the other hand, if somebody else distills knowledge with llama in order to make a better model, and happens to release it for free without having a commercial use for it themselves it should be fine.

Reply on news.ycombinator.com