I'm currently writing up a deployment architecture for LLM's and the API question is answered here https://fine-tuna.com/docs/choosing-a-model/model/

Basically you can get a Docker container that will publish an Open AI API compatible end point. You can then choose the model that sits behind that API.

As deployment will be in Kuberenetes we will clusters with GPU resources to maxz out performance but we're not there yet.