Ollama.ai is pretty good too, any differences with this one?
Seems like all of these open source wrappers, just as the closed sourced ones, are a race to the bottom.
Seems like all of these open source wrappers, just as the closed sourced ones, are a race to the bottom.
The focus for Ollama is to make downloading and serving a model easy – there's an included `ollama` CLI but it's all powered by a REST API. Hopefully, it's a way to support really cool applications of LLMs like OP's onprem tool.
OP's tool is more focused on ingesting and analyzing data. There seems to be quite a bit of interesting opportunity as an application of LLMs – e.g. analyzing not only local docs but data in a remote data store.