Hacker News Reader

Ollama with WebUI https://github.com/open-webui/open-webui

Not sure why your comment was downvoted. ^ is absolutely the right answer.

Open WebUI is functionally identical to the ChatGPT interface. You can even use it with the OpenAI APIs to have your own pay per use GPT 4. I did this.

Hey can you guys elaborate how this works? I'm looking at the Ollama section in their docs and it talks about load balancing? I don't understand what that means in this context.

You probably want to look at the getting started guide

https://docs.openwebui.com/getting-started/

IIUC the load balancing page is for people who want to run openwebui at a larger scale

https://en.wikipedia.org/wiki/Load_balancing_(computing)

Reply on news.ycombinator.com