Hacker News Reader

I see it in a slightly opposite way: even the good models are relatively cheap, and so I worry what we might miss by spending too much time playing with the Sonnets of the world when the Opuses are still objectively a bargain for the power they bring.

View on HN

> when the Opuses are still objectively a bargain for the power they bring.

The cost isn't just what you're billed. There are security, privacy etc. concerns.

I know companies that are using github, even using public repo, and request their teams to not use SOTA models, but are ok with local models. Just stupid policy.

If Orang mane bans GitHub they've got their local clones and can whip out a local server and a CI solution.

If Orang mane bans Claude, they've got their local models.

The latter has already happened too so I'd say their risk modeling is spot on.

If you're writing open-source code then there's obviously nothing wrong with publishing it in a public repo. "Using Github" doesn't require you to use their CI, but even then, a human managing secrets for GitHub CI is worlds apart from trying to make sure an internet-connected agent doesn't leak secrets. And if you have sensitive data that you can't send to a remote model but you would benefit from the technology, then processing it with a local model without network access is the obvious way to address that.

Reply on news.ycombinator.com