Like Ollama, but for your own cloud [Apache 2.0]

github.com

4 pointssupo1 comment

Open-source k8s cluster for serving a wide catalog of small language models across search, OCR & data processing.