Hacker News Reader

Llama 3.1 8B model

So this demo is around 90 times faster than typical speeds for the same model at openrouter, and around 30 times faster than the absolute fastest option available (Groq).

https://taalas.com/h-content/uploads/2026/02/graph.png

https://xkcd.com/1162/

im assuming energy expenditure is substantially lower as well

Reply on news.ycombinator.com