Hacker News Reader

Very impressive numbers - I'd expect 2K tok/s on Cerebras hardware, not H200's.

I don't think it would be economically viable to serve the full DeepSeek models on Cerebras hardware.

I'm a huge fan of their hardware - we've been promimsed wafer-scale integration since the 1980s and they delivered it. It'd be a shame if their tech ended up a dead-end.

On the bright side, they haven't started exploring stacking chips on top of their wafers to increase local memory, and every process change will bring increased bandwidth in and out of their "pizza". I really wish they succeed.

Well it looks like as you were typing your comment, a press release was going out announcing OpenAi’s $10B investment in Cerebras.

Oh, I'm also a fan. It is really cool to see what they've done. However, in the current systems they have available, they would (as far as I've understood it) just need way to many racks to be able to serve the full Deepseek model for it to have any kind of economics. The main limiting factor is the amount of sram available per wafer.

Reply on news.ycombinator.com