h2o_wine

You don't have to take my word for it.

https://www.aiville.com/c/anthropic/api-that-auto-routes-to-...

My credit card isn't in there. The app was written 6 months ago where it stayed in Beta. I rolled it out as a way to reduce the cost of development. Use it or don't. It will be obsolete in another year or two when AI calls level in price.

It's a tool not an SEO branded, shiny website. It's a utility. & model pricing varies considerably for now. This tool will be useless in another year or two.

I screwed up the routing & it sent everything to Anthropic when I updated from Beta & ended up losing money. The case study was done 6 months ago.

It's a simple tool. Use it or don't. The only person who would lose money in error is me.

Actually I updated it to Gemini 2.0, GPT-4o, GPT-4o-mini, and Claude 3.5 Sonnet, Haiku. I did it when I realized I accidentally routed everything to Anthropic first & got hit with a $13.62 bill on rollout.

Moral of the story is, the only one who loses $ is me

It totally isn't. In a reply above I explained how I accidentally routed to Anthropic first & ended up losing $13.62 before I realized my mistake.

The moral of the story,if something gets screwed up, I end up paying

Actually, I accidentally routed to Anthropic first and ended up losing $13.62 but it does work. I've used it for two of my other projects.

I created it for people using AI in development. The 1st 50 tokens are free.

Out of frustration, I built an AI API proxy that automatically routes each request to the cheapest available provider in real-time.

The problem: AI API pricing is a mess. OpenAI, Anthropic, and Google all have different pricing models, rate limits, and availability. Switching providers means rewriting code. Most devs just pick one and overpay.

The solution: One endpoint. Drop-in replacement for OpenAI's API. Behind the scenes, it checks current pricing and routes to whichever provider (GPT-4o, Claude, Gemini) costs least for that specific request. If one fails, it falls back to the next cheapest.

How it works: - Estimates token count before routing - Queries real-time provider costs from database - Routes to cheapest available option - Automatic fallback on provider errors - Unified response format regardless of provider

Typical savings: 60-90% on most requests, since Gemini Flash is often free/cheapest, but you still get Claude or GPT-4 when needed.

30 free requests, no card required: https://tokensaver.org

Technical deep-dive on provider pricing: https://tokensaver.org/blog/openai-vs-anthropic-vs-gemini-pr...

I wrote up how to reduce AI costs without switching providers entirely: https://tokensaver.org/blog/reduce-ai-api-costs-without-swit...

Happy to answer questions about the routing logic, pricing model, or architecture.