That doesn't let me send requests to my local litellm instance, though. You have to be able to configure the endpoint that requests are sent against as well.
Nice. LiteLLM was just the thing I've been looking for and hoping to integrate.
Hell yeah. Good luck!
Do you know if there's anything out there like LiteLLM that includes OpenAI's whisper model? I took a look at the litellm package and it doesn't appear they support the audio module. :/