Really there needs to be a product based off of LLMs similar to Alexa or Google home where instead of connecting to the cloud it’s a locally run LLM. I don’t know why one doesn’t exist yet or why no one is working on this
You mean like Ollama + llamacpp ?
We know there’s a market out there for Alexa and Google home. So this would be the next generation of that. It’s the nobrainer next step.