Hi there! To the developers:
Is there a way to use a personally owned and hosted LLM? If not, is there an interest in developing such a feature?
Is there a way to use a personally owned and hosted LLM? If not, is there an interest in developing such a feature?
For search we already use a offline/self-hosted model from HuggingFace. And you can easily configure it to use other SentenceTransformer models from HuggingFace
For chat, follow this feature: https://github.com/khoj-ai/khoj/issues/201 to see when Khoj gets the ability to use offline/self-hosted chat models