Personally I'd recommend Ollama, because they have a good model (dockeresque), the APIs are quite more widely supported
You can mix models in a single model file, it's a feature I've been experimenting with lately
Note: you don't have to rely on their model Library, you can use your own. Secondly, support for new models is through their bindings with llama.cpp