Hacker News Reader

also means that OpenAI can just swap in Llama 2 and increase their capacity by orders of magnitude

this is the age (or year) of token price arbitrage

IIRC Facebook explicitly licensed against that use case.

Did they? For llama 2? I remember the first llama license

Per the Llama 2 license, companies with "greater than 700 million monthly active users in the preceding calendar month" must get approval and permission from Meta to use it.

For OpenAI - that is very interesting though. The 700M cap means the big FAANG+ companies that Meta competes with - Google, Apple, Amazon, Netflix, even Microsoft - can't use Llama 2.

But OpenAI has less than 700 million users? So theoretically, if Llama was better than GPT models, OpenAI could replace their GPT engine with Llama :)

This is ignoring OpenAI's margins. We don't know how much GPT-3 and GPT-4 actually cost for them to run but it isn't what they are charging us. For Llama 2 the quoted cost is just compute, but for OpenAI you are also paying for using their software.

[Author] As an end user, you pay the published price of $1 per million tokens for alternatives (such as Anyscale Endpoints -- https://app.endpoints.anyscale.com/landing, but there are others -- Replikate, Fireworks etc). This isn't just the compute price -- there's some margin in there as well.

Reply on news.ycombinator.com