Show HN: Open-source alternative to OpenAI Assistants API
superflows.ai
Henry and Matt here: we’ve built Superflows - a fully open source alternative to the OpenAI Assistants API. It makes it easy to add an AI assistant to a SaaS product.
The assistant answers questions or completes tasks for the user by calling API endpoints in your SaaS product. E.g. a user could ask their CRM assistant “Eve is sick today, move her calls to the rest of the team - prioritise those who’ve had prior contact with the prospect” and the assistant would do this by calling the CRM’s API.
Like OpenAI’s recent Assistants API release, it handles threads, chat history, RAG on your docs and API call selection, but without the lock-in to OpenAI & you can self-host.
It supports various LLMs: an OS model we fine-tuned (based on Mistral 7B), fine-tuned GPT3.5 & GPT4. We also support Claude 2, Llama 2 and PaLM, but haven’t tested them rigorously. We’re still working on streaming the Mistral model, but have it hosted without for now.
You can upload your swagger file (OpenAPI spec) to get up and running. Endpoints can be enabled/disabled and you can evaluate performance in the playground. There’s a React component library for easy integration.
You can self-host for free. We're charging for the cloud version. This has faster & easier setup, user permissions, analytics (soon) & support.
Give it a spin and let us know what you think!