1,318 karma · joined March 17, 2012
In my domain IIoT, I even created a yaml structure to make this easy. https://unsframework.com (wip)
I am also sure tomorrow there will be another new thing.
I think of a little like Notepad++ for llm's instead of just Notepad.
I use it hourly, in the morning I have a summery of HN from overnight along with news, and reminders.
I host it on Digital Ocean, it uses about 15-20 API's from AI companies but also web search, document and kv stores etc.
Interested in trying it let me know.
ChatGPT is not simply the gpt-4o model, it's the model, a system prompt, tools and a virtual environment running python.
I built my own app, when using it i don't get links to partners because i don't mention such a thing in the system prompt.
https://old.reddit.com/r/ChatGPTPro/comments/1b6kzlo/comment...
Regardless I see the API's as remaining stable.
Yes also Azure is a good backup anyway now or anytime, you can fall over to the Azure API with a key change and a url.
https://js.langchain.com/docs/modules/data_connection/ https://python.langchain.com/docs/modules/data_connection/
Also OpenAi last week released Assistants which is an easy way to achieve RAG without needing new tools such as Vector Db's. Although 5000 docs is perhaps to large for assistants.
The first decision is whether you would use an Open Model such as Llama2 and host that yourself or a Model such as GPT 4 from openAi or Claude2 from Anthropic etc.