Hacker News Reader

The numbers are pretty incredible. Will the competition be able to match them?

Groq is claiming 284 tokens/second on Llama 3.1 70b, so they’re in the same ballpark.

If Groq 2 is 2x faster it will match Cerebras WSE-3.