Most inference servers are OpenAI-compatibile. Even the "official" llama-cpp server should work fine: https://github.com/ggerganov/llama.cpp/blob/master/examples/...

Ollama runs locally. What's the best option for calling the new Mixtral model on someone else's server programmatically?