If you’re serious about production deployments vLLM is the best open source product out there. (I’m not affiliated with it)