> I really wish there is a way to fact check all, instead of depending on good samaritans in a comment on HN to point these obvious misconceptions out.
You mean like reading original sources? Frequently, big research projects like this come with an official paper[1] and/or blog post[2] explaining what they did.
[1] https://ai.meta.com/research/publications/code-llama-open-fo...
[2] https://ai.meta.com/blog/code-llama-large-language-model-cod...