OllamaMQ

github.com

1 pointchleba1 comment

High-performance Ollama proxy with per-user fair-share queuing, round-robin scheduling, and a real-time TUI dashboard. Built in Rust.