Try LiteLLM; their core LLM proxy is open source. As an added bonus it also supports other major providers.