Hacker News Reader

Comment by L8D | Hacker News Reader

If you're not paying for the model through Open router, then which provider are you buying it from? I thought that if that provider was listed on open router it would be the same price as going directly to the provider? Are you buying from a provider that isn't listed on open router already?

View on HN

> Are you buying from a provider that isn't listed on open router already

I am using openrouter with zdr guardrail which routes to any provider that supposedly doesnt train on user data. I also use fireworks (directly, not via openrouter) which is a provider promising zdr and has a bunch of open weights models. My issue is that these zdr providers dont transparently disclose caching/tokens etc and so they end up being far more expensive than directly using DS.

Have you tried Novita? They're zdr and I find they usually have better cache hit rates than fireworks. No affiliation.

Thanks for the input. Let me check it out.

> OpenRouter has taken the stance that in-memory caching of prompts is not considered “retaining” data, and we therefore allow endpoints/models with implicit caching to be hit when a ZDR routing policy is in effect. [0]

OpenRouter doesn’t list DeepSeek as ZDR combined with Caching. Thanks for the tip of Fireworks as Fireworks has Zero Data Retention by default. [1]

[0] https://openrouter.ai/docs/guides/features/zdr

[1] https://docs.fireworks.ai/guides/security_compliance/data_ha...

Reply on news.ycombinator.com