Hacker News Reader

Nvidia's top AI chip, Rubin, sells in 72-GPU racks for about $3.5–7.8M. A rack running Xiaomi's MiMo V2.6 Pro could generate roughly 150–300B tokens a day, worth about $130–260k at Xiaomi's API price. That's a payback of a few weeks in theory.

So yes, we are getting scammed by American SOTA.

View on HN

Interesting. Then my theory is that the free market inference providers have low utilisation (e.g. 20% avg; 100% at peak), slowing their amortization rate. The OpenAI/Anthopic rates must then have been based on a time when there utilisation was peaky and mostly idle (e.g. 10/20%). That would maybe explain the 10-20x cost difference between coding plans and API.

Reply on news.ycombinator.com