110

Thanks! Do try it out and let us know if it works for your use-case?

That's (almost) exactly what khoj search provides a search-as-you-type experience but with a natural language (instead of keyword) search interface.

My workflow looks like: 1. Search with Khoj search[1]: `C-c s s` <search-query> RET 2. Use speed key to jump to relevant entry[2]: with `n n o 2`

[1]: `C-c s` is bound to `khoj` transient menu [2] https://orgmode.org/manual/Speed-Keys.html

No, we don't yet. Lots of developer folks want to try different models, we want to provide simple to use, but deep assistance. Kind of unsure what to focus on given our limited resources.

Thanks!

We've just been testing integrating over voice, whatsapp over the last few days[1][2] :)

[1]: https://github.com/khoj-ai/khoj/tree/khoj-chat-over-whatsapp...

[2]: https://github.com/khoj-ai/khoj/compare/master...features/wh...

Hi Mithril,

For search we already use a offline/self-hosted model from HuggingFace. And you can easily configure it to use other SentenceTransformer models from HuggingFace

For chat, follow this feature: https://github.com/khoj-ai/khoj/issues/201 to see when Khoj gets the ability to use offline/self-hosted chat models

1. One of the reasons we created Khoj was being able to do natural language search with embeddings generated offline using open-source models!

2. We don't use any vector datastores (yet). You can do a lot in memory, it's faster and it does exact matches (no KNN, approx matching)

Feel free to ask if you were looking for something more specific?

I can expand on that (I'm the other developer working on the project).

> Seen a few of these. Are you all working on providing an easy way to maybe use LLMs for chatting/search without sending my data to OpenAI? If yes, how will you verify the quality is "reasonable"?

We're working on building a helpful AI assistant, with or without OpenAI. We use offline SentenceTransformer models for search and OpenAI (currently) for chat.

To allow user to verify quality, with search you've to look at the quality of the results returned. For chat we pass references (from your docs) used to generate the response. A lot more should be done, open to suggestions.

We also have our own chat quality test suite that "benchmarks" chat capabilities (via pytest)

> How is this better than Rewind, Needl, Mem, etc all the personal search engine that have been doing the rounds lately from various knowledge bases? Is the selling point that it's Open-source? Also if Apple improves spotlight, I wonder how useful this will be.

- I've tried Rewind. It's a neat project with a slick UI, no doubt about it. But 1. It has a cold boot problem (you can only search stuff you've opened since you installed Rewind) and 2. It's limited to Mac (M1+) machines. Khoj will index all supported files across your data sources and it can run on other machines easily.

- Needl, based on their homepage, seems to provide fuzzy/keyword based search. Khoj search works offline and supports natural language queries (e.g search for "sold my car for" and it'll find notes about your Toyota Corolla or Ferrari)

- Mem.ai is pretty neat as well. We'd love to add all the features they have. With Khoj you can self-host if you prefer or use Khoj cloud if you want to sync across devices. And it integrates into your existing tools (Emacs, Obsidian and Web)

In summary, Khoj being open-source is a critical differentiator for an AI assistant to be trustable (you can see what the code is doing). But all the AI assistance approaches are also different.

We're already on it: https://github.com/khoj-ai/khoj/pull/284 :)

In case folks are interested in trying it out, I just released the Obsidian plugin[1] for Khoj (https://github.com/debanjum/khoj#readme) last week.

It creates a natural language search assistant for your second brain. Search is incremental and fast. You notes stay local to your machine.

There's also a (beta) chat API that allows you to chat with your notes[2]. But that uses GPT, so notes are shared with OpenAI if you decide to try that.

It is not ready for prime time yet but maybe something to check out for folks who are willing to be beta testers. See the announcement on reddit for more details[3]

Edit: Forgot to add that khoj works with Emacs, Org-mode as well[4]

[1]: https://obsidian.md/plugins?id=khoj

[2]: https://github.com/debanjum/khoj#chat-with-notes

[3]: https://www.reddit.com/r/ObsidianMD/comments/10thrpl/khoj_an...

[4]: https://github.com/debanjum/khoj/tree/master/src/interface/e...

> For example, the AI models we have now will happily run forever if supplied with external power.

A human will run forever as well if supplied food (external power), a new body (computers degrade) and genetic data protection (hard drives corrupt) :)

While AI models may not be quite there yet, their world seems fairly similar to ours in the important ways of environmental constraints and survival pressures

> If the entity doing the cognition didn’t evolve said cognition to navigate a threat-filled world in a vulnerable body, then I have no reason at all to suspect that its experience is anything like my own.

An AI model needs to evolve its cognition to successfully navigate its training environment for survival.

Shouldn't that satisfy your criteria for suspecting its experiences to be like your own?

- The official website is at https://www.stateof.ai/

- The report provide a great overview of the State of AI from previous years too. See https://stateof.ai/2020

- An overview of the State of AI 2021 is at https://www.stateof.ai/2021-report-launch.html