I use it as a daily driver (built https://recurse.chat/).
Local RAG and chat with PDF is handy. Some of our users are using it to format transcripts (example: https://talk.macpowerusers.com/t/recursechat-little-app-to-u...).
Local RAG and chat with PDF is handy. Some of our users are using it to format transcripts (example: https://talk.macpowerusers.com/t/recursechat-little-app-to-u...).
Question: "no config setup" You mean the user doesn't have to pre-install Ollama or build llama.cpp or anything?
If you don't mind me asking - how are you accomplishing that in an offline desktop app?
It doesn't require Ollama, but if you have existing Ollama, it works with Ollama's API compatible layer https://recurse.chat/faq/#openai-chat-completion-models.