4,626 karma · joined August 27, 2014
Also find me online at https://dakota.omg.lol
[ my public key: https://keybase.io/dcchambers; my proof: https://keybase.io/dcchambers/sigs/CielLJC5Pfe0UTU4IA1NtejSgwWJKjWYUuMg4BVqX4I ]
And by that I mean almost no one in charge will be held responsible.
All I mean is that none of the frontier LLMs are significantly better than the others for the vast majority of work, so devs are free to move between providers freely.
One of the major LLM providers goes down for some reason. Traffic shifts to the other providers because devs have no loyalty. LLMS are commodities. The other providers can't handle the increase in traffic and they go down as well.
It's easy enough for Omarchy folks to add "verified" or "trusted" developers down the line.
Might as well be a trillion dollars as it's never getting paid.
Using something like OpenRouter (or any of the AI Gateways) is better than tying yourself to one LLM provider that can rug pull on pricing or change models in a way you don't like.
The value is in the network effect I think. OpenRouter is popular and has a good head start over anything Stripe could build internally.
What secret sauce do they have?
Why does any company do anything? Money, of course.
No one is forcing you to buy used books with writing in them.
Most of them aren't worried about AI safety, politics, religion, etc. It's really not that deep. They just want to get rich.
There's nothing wrong with that, but let's call a spade a spade.
The hyperscalers like AWS will made great use of these to serve up models that will be relevant for several years. But right now, we're still seeing significant bumps in model quality every couple of months - especially with open-weight models like Deepseek/Kimi/GLM.
Until that point, though, I don't see how this is ever going to be cost effective vs general purpose hardware.
I also think we'll see miniature versions of this baked into mobile hardware for super fast and efficient on-device LLMs.
All of these price increases are going to get passed down to consumers eventually via increased prices.
1. The sheer number of tokens that a coding agent can use flipped the math upside down on this equation. If you use the most expensive model for everything those costs quickly become untenable, even for software companies.
2. We realized many of the coding problems we're solving aren't incredibly difficult.
The company is fascinating. The "everything is open" nature of how they build the business is an incredible value for people that want to see how the sausage is made...but it hasn't ultimately lead to a better product.
The next five years are going to be truly WILD in the software world.
Air-gapped systems are gonna be huge.