When will "local" LLMs hit?

4 pointswayne-wang11192 comments

Given the burst of LLM applications and RAG’s improvement, I am surprised no existing projects build a local, private llm for more secure and proprietary use cases that needs a local llm app with local rag that functions without internet.

View on HN

Also consider this: what would be cool is to enhance scalability of local llms by exchanging some latency of the hardware level, and makes it more powerful local llm for different usecases. But when will such a usecase arise? Isn’t our data shared across these foundation model’s companies a huge concern?

https://bionic-gpt.com

Reply on news.ycombinator.com