LLAMA is also exactly my point -- LLMs are pretty well-proven at this point. If you spend $X on machine learning researchers, you can get an LLM with Y parameters that is useful for various tasks like sentiment analysis, machine translation, etc. Facebook should be spending money on that because they have lots of cash, data centers, and ML researchers so they can do this at scale that only a few others can (Google, Microsoft/OpenAI and maybe Amazon).