Hacker News Reader

Why are llama 3 weights listed as partially available ?

Also Olmo didn’t release a paper per se but a very detailed blog post / cookbook for reproduction which should count to a perfect score imo

View on HN

One issue with AI2 (who makes Olmo) is that some of their input data sets are filtered and curated, to remove things that they deem politically or ethically unacceptable like “toxic” content. This step obviously influences the LLM, but as far as I know it isn’t done transparently in an auditable way. I think being truly open would require a raw dataset to be available without this curation, along with a log of every single instance of curation. The dataset should also not be attached to a restrictive license as they have done.

https://blog.allenai.org/dolma-3-trillion-tokens-open-llm-co...

> Why are llama 3 weights listed as partially available ?

When you hover over it, it explains: "Requires signing consent form"

Reply on news.ycombinator.com