Just got to know about pinokio, I think they are taking the approach of replacing existing browsers. We are trying to empower existing browsers, both pros and cons and that's the major difference I can see.
15 karma · joined October 22, 2020
Will add the encoders as needed, should be easy now, but a great point.
This seems like the perfect use case for Browserai!
We are adding features like RAG and observability integrations so people can use these llms to perform more complicated tasks!
With just three lines of code, you can run Small LLM models inside the browser. We feel this unlocks a ton of potential for businesses so that they can introduce AI without fear of cost and can personalize the experience using AI.
Would love your thoughts and what we can do more or better!
How It Works - Offline Indexing: Docs are processed and embedded using the GTE-small model at build time.
- Browser-Based Magic:
- - SQLite database (stored in the browser) for vector search.
- - Local embedding model for query processing.
- - Local LLaMA model for response generation using WebLLM.
- - Everything Happens Locally: No data leaves the user’s device.
Key Benefits No API Costs: Everything runs in the browser—zero backend expenses.
Unlimited Chats: No rate limits or usage restrictions.
Privacy-First: Your data stays on your device, always.
btw had a request, I saw your repo lacks proper documentation. We are building an open source ai documentation system, I would love to try if I may have your permission to build docs and create a PR!
You can checkout our project here: https://git.new/akiradocs
Additionally, we are exploring ways to improve the consumption of these documents and ensure they reach customers when they need them. Unfortunately, this project will be closed-source!
We would love your feedback on this and any additional features you would like to see.
Currently, we are also working on the capability to automatically generate documentation from your repository using AI.