Hacker News Reader

> GPT-5.6 Sol on Ultrafast mode, delivering up to 750 output tokens per second

> delivering 17k tokens per second per user on Llama 3.1 8B model.

Obviously this is a much smaller model, but I really can't wait for ASICs to take over the LLM space.

Imagine running a model like Sol/Fable (even half the size with 60-70% of it's intelligence) on your own ASIC hardware.

ASIC makes it sound like it's a single chip, but in reality serving trillion-param models on Cerebras requires a full cluster (as in multiple racks, MW of power).

Some interesting twitter analysis here:

https://x.com/bleysg/status/2073937651150029084

I'd take qwen3.6 (3.8 as of tomorrow) 27B running at 17k per second first on the way to Sol/Fable! And then dsv4-flash-0731!

Right! Not sure that will happen since Talaas was just bought by AMD, so more likely a US model. Still, we can dream.

Indeed, you could literally brute-force it that way :)

Reply on news.ycombinator.com