Just get a Mac Studio with 512GB RAM and run a local model when the internet is down.
Peak HN.
But you can at least resell that $10k Mac Studio, theoretically.
But, alas, not a single upvote.
Lets say a cluster of raspberry pi's / low powered devices producing results as good as claude 3.7-sonnet. Would it be completely infeasible to create a custom model that is trained on your own code base and might not be a fully fledged LLM but provides similar features to cursor?
Have we all gone bonkers sending our code to third parties? The code is the thing you want to keep secret unless your working on an open source project.