These sort of fast and cheap models are great for tasks that are verifiable and can be retried infinitely (like coding), you can basically get frontier results with a good harness (at a fraction of the time and money).
These sort of fast and cheap models are great for tasks that are verifiable and can be retried infinitely (like coding), you can basically get frontier results with a good harness (at a fraction of the time and money).
OpenCode has “providers” for many (many!) other services, but these are almost all unofficial and against ToS (Anthropic being famous for ban-hammering people).
Or choose Oh My PI [2] for batteries included
[1] https://github.com/earendil-works/pi [2] https://github.com/can1357/oh-my-pi
Makes it easy to switch between models and I like it for exactly the reason that you're saying - I prepay and so can't accidentally spend my food budget.
I would normally advise against such efforts for a variety of reasons (such as inaccurate tracking, etc), but specifically under pi, this mechanism has been extremely well behaved and accurate for me.
That said, it is probably easier to use APIs from FireWorks.ai, Ollama Cloud, Open Router, etc.
Anyway - if you're a dev - you would be writing your own agentic env right ? that's the best way forward. I wont tell you more than this . but if you're not - you are losing out .
To preempt certain replies, yes, I know you can pay API prices and use whatever harness you want.
I might be wrong about this, but obviously Google would like to provide inferencing at the lowest cost to themselves, so perhaps their slow ‘pro’ releases and rapid ‘flash’ releases is an attempt to guide people to use more profitable models?