LLMRouter: An Open-Source Library for LLM Routing

Amount of emojis makes me uncomfortable

Yeah definitely gives off that "we generated this project with an LLM" smell.

It's a bit annoying that every AI library implements it's own protocol handlers for every provider - OpenAI, Google, Anthropic.

I'm not talking about the routing part, thats cool, but about how you need to load the API keys in this library.

We need something like Language Server Protocol, where we have a single openai library, a single gemini library, and all libraries use that.

Great concept! Have had to build some bare bones solutions to handle LLM routing but no reason I needed to roll my own. Planning to give this a go next time I run into that issue.

Are you thinking about integrating smarter cost monitoring and reporting into routing as well?

How does it determine task complexity? Or is this a parameter the user passes in?

I think the expectation is you provide your own training data for task complexity and the router trains a model for you.

meh