Hacker News Reader

Comment by PcChip | Hacker News Reader

>We run all our Personal Assistants now on flash

are you worried about sending all your data to third parties, especially if they're in different countries?

Not shilling for them but Ollama cloud hosts domestically with ZDR afaik. I run 95% of my open weight inference through them. The rest goes through Opencode Go $10 plan (which is enough to run 3 hermes agents on DSF 4.1 and leave plenty of left to experiment with when new models drop).

Just a reminder that any API using a Cloudflare TLS certificate isn't ZDR.

The model engine provider might be ZDR, but the service as a whole isn't.

did not know. ty! have my updoot as thanks

Cloudflare doesn't retain request bodies by default, and if you don't trust that then you shouldn't trust the third party AI provider either. Cloudflare does cache responses, but that doesn't typically apply on API endpoints and is trivially disableable.

Cloudflare doesn't retain request bodies

Pinky-swear!

you shouldn't trust the third party AI provider either

I trust competing American AI labs to not collude with each other, so I can spread my work across them and nobody sees everything.

I trust Chinese AI providers to not work with the NSA.

And of course there's always tinfoil.ai's attested model engines... probably the only non-evil use of Trusted Computing I've ever seen.

But Cloudflare is different. They're the single point of access for everything. Which is precisely why they attract irresistable government pressure. Trusting them is like painting a target on your back.

Just use a provider hosting it in your country especially if your country has major data centers then its the same as using Anthropic or GPT of GCP Model Garden or AWS Bedrock

nobody here is talking about running frontier level intelligence locally so if you’re Chinaphobic and prefer layers of corporations siphoning your data in between you and the party there are plenty of options instead of directly to the party

We use hosted providers in the EU. They have a cost markup but its worth it. I enjoy the idea that I do t talk to big tech.

I cant ofc be fully sure because i don’t own the chain end 2 end.

Could you please share which ones? I need serious ones with generic DPA but without Enterprise plan costs.

I use it through OpenRouter, which has ZDR enforcement.

I have asked OP that question but I think there are providers who are not in China and they just host the model/inference.

should you not be worried more about sending data to providers of your own country? I think they are equally bad personally, but if you think one of them is acceptable, why do you prefer it to be your own government that has more ties to your life?

what would be the concern here?

Reply on news.ycombinator.com