Lower prices will not reduce AI spend. They will simply increase usage.
There is no real ceiling on how much companies can delegate to AI. The only limit is the floor where spend too little, and you simply stop being competitive.
It is unlikely this kind of agentic workflow will ever get cheaper. Agents get stuck in doom-loops quite often, just burning tokens without any value. Especially by prompts created by people unfamiliar with the codebase.
And it is becoming increasingly obvious that better models just use more tokens (and take longer to execute on prompts). So this kind of human-out-of-the-loop workflows will be forced to use cheaper models and be time-gated in order to not waste tokens. And then they will also produce worse results than a manual change or a more powerful model...
If tokens get cheaper you just put a better model for this kind of problem and let it run for longer.
But what is more insane is that we are using a ton of cloud VM time on top of a ton of tokens just to save a few minutes from a developer doing the same on his machine...
I don't think my company will keep this system once the free credits run out once they realize how much it actually costs.
This seems like a very '500kB is all you'll ever need' thing to say. This exact scenario has seen a precipitous decline in cost and increase in reliability over the past year.