Hacker News Reader

To be fair, it isn't $1000-2000 extra, it's the new laptop/pc you just bought that is powerful enough (now, or in the near future) to run these open weight models.

Ease of use is a major issue.

What percentage of the people that you know are able to install python and dependencies plus the correct open weights models?

I'd wager most of your parents can't do it.

Most "normies" wouldn't even know what a local model even is, let alone how to install a GPU.

That sounds like all software. We can make better software.

Wiredpancake got flagged to death but they’re right. MacWhisper provides a great example of good value for dead-simple user-friendly on-device processing.

installing LM Studio is easy and it walks you through choosing a model as well. It is actually well within many people's abilities.

You mean like a home with a yard large enough to keep the neighbors out of sight?

Granted, based on how annoyingly chill we are with advertisements and government surveillance, I suppose this desire for privacy never extended beyond the neighbors.