Hacker News Reader

Comment by ggcr | Hacker News Reader

Ziphu has that many resources to be able to serve capacity for 1 quadrillion tokens per day on Nous portal? My bet is that it's a Composer model from Cursor running on xAI cluster, they already did a Composer based on Kimi-K2.5

View on HN

There's three options here:

- The provider has a massive amount of (unused) hardware. Google or Cursor seem most likely

- The model is extremely efficient, beyond anything we've seen so far

- Whomever made the model has improved the cache efficiency in such a way that it's very cheap to serve. See e.g Deepseeks or Xiaomi caching (pre-price increase)

Option 4: the claimed capacity is not true. Real world usage hasn’t reached anywhere close to it.

    > 1 quadrillion tokens per day on Nous portal

If you are referring to this number (https://xcancel.com/NousResearch/status/2090899914700054780), they are either mistaken, or they mean that they can route 1 quadrillion tokens per day, but the provider behind Ox Alpha certainly can't provide that. Almost all of my requests have hit a rate limit so far.

I was hitting 429 overloaded regularly with Ox on OpenRouter yesterday, but a lot of that turned out to be problems with my harness. I fixed some bugs, improved the back-off, and I haven't hit a 429 error since (touch wood).

OpenRouter says they're doing 6 Trillion tokens a day with Ox Alpha so far, and it has been their biggest launch of all time. OpenCode claimed they had capacity for 100T a day.

https://x.com/OpenRouter/status/2091912024922177562 https://x.com/opencode/status/2090544355824038300

Reply on news.ycombinator.com