Hacker News Reader

Thoughts on any-llm-gateway versus litellm-proxy?

litellm is a great library, but one team using litellm-proxy reported having many issues with it to me. I haven't tried it yet.

View on HN

What were the problems? I've been trying it out and haven't hit issues yet, but not using it at scale yet so I'm curious what to watch out for. I figure it's open source (MIT) so I can make changes as needed if there was anything particulary annoying.

Yeah, I wonder what gaps in Litellm Proxy made Mozilla want to even do this.

Reply on news.ycombinator.com