sabaimran

It still provides really good semantic search! The search will return snippets from your raw data itself, while the LLM gives you the experience of chatting with it.

Hey activatedgeek! Thanks for sharing Khoj. @110 and I are the developers.

Lots of great discussion going on in this thread. Two things we want to clarify:

1. Search works offline. Chat uses OpenAI.

2. We're working on adding open source LLM support for chat. We're evaluating quality and ease of setup for this.

If you find the project interesting, hop on our Discord and share your thoughts: https://discord.gg/BDgyabRM6e.

We very much want to hear about your experiences and how we can make something more useful for the community.

Search does currently work 100% offline - none of your data would be sent to OpenAI if all you're doing is searching for your local documents. You could completely disable your internet connection and it would still work.

Chat currently is only integrated with OpenAI because it had the highest quality + lowest barrier to entry. We're experimenting with open source LLMs and hope to have an alternative available soon.

The GPT integration only works if you pass Khoj an OpenAI key in your settings, so it's a pretty explicit opt-in. Otherwise, there's no way for Khoj to send data to OpenAI. Does that make sense?

Ah, I always forget to mention. We do also index images, but haven't tested OCR.

Like you could search for "bike by the lake" to get relevant images, but not search for the text within an image.

I understand your concerns, but let me zoom out a little here and talk about the nature of open source.

Open source means that the source code which is developed for a piece of software is fully open (i.e, anyone can read, fork, modify the code) for what they are installing.

According to your definition, it would be really hard to do anything that is fully, end to end, open source. We've developed the code on Macs, hosted the code on GitHub, written plugins for Obsidian and GitHub, hosted the website on AWS. All of those are closed sourced software.

https://www.redhat.com/en/topics/open-source/what-is-open-so...

That being said, we are planning to integrate an open source LLM soon. When we added chat, Open AI just had the best one, but the space is changing so quickly. We're both super enthusiastic about seeing all the open source tooling for this stuff evolve.

1. Khoj has been around since early 2021, and both of us have been contributing to open source for several years. Being open source for a project like this just makes sense. 2. Search actually is 100% offline. It's using sentence transformer models from huggingface. 3. Chat uses OpenAI's model only because they're currently best in class (and easy to set up). Our plan (more of a 6-month view) is to have our own open source LLM hosted for inference. See issue for reference: https://github.com/khoj-ai/khoj/issues/201

Quite cool! It looks like this tool is oriented around ephemeral sessions, while Khoj is meant to be personal and local to you.

Those are cool use cases! PDFs with text should work. Maybe I should try and index my download folder too :-).

We already index org, markdown, and PDF files on your file system. We're adding a text connector soon, which will allow you to index any plain text files you care to.

With that, you should be able to index Gmail over Maildir/POP/IMAP?

Hello! One of the developers of Khoj here.

The way we see it, building in the open is going to be critical for creating an aligned, trustworthy AI assistant.

Note: while all LLM tools look fairly similar on the surface these days, our specific approaches are fairly different. Give us a try and see what you think :-)