Hacker News Reader

Comment by emilsedgh | Hacker News Reader

> driven by consumer desire for local LLMs

Citation needed. I don't think general public has any desire/care for that. Like they don't care about a locally run Siri.

View on HN

I would love a local Google Home. The response time is abysmal and the results are often poor. I should at least be able to control my home lights without internet.

Individuals may not, but businesses absolutely care that their data isn't accessible to third parties

Really? Most businesses don’t seem to have any trouble uploading data to AWS.

There's a massive difference between companies providing you services where they interact with your data only and AWS which provides you infrastructure and doesn't care much what you do with it. There's not a single case I'm aware of where someone complained about Amazon accessing their private data in AWS and using it in any way.

Walmart refuses to use AWS, for what it is worth. And no, I don't think there is a functional difference between what AWS does and what is described above.

That makes sense for Walmart. They don't want to sponsor the competition and the risk of leaking secrets may be unacceptable, even if you trust AWS operations to behave properly. I think Walmart is a complete outlier in this topic and they wouldn't use AWS even if homomorphic encryption was realistically usable for all their software.

On the other hand, Netflix did (does?) use AWS.

I think local LLMs, if available and equivalent to GPT4, it will most certainly be preferred over ChatGPT.

Reply on news.ycombinator.com