Anyway: Zero, as of right now.
I fully expect to be able to run useful LLMs on a machine I can justify buying for other reasons. I already can on the secondhand kit I own, and I don’t expect the cost-benefit analysis of local LLMs to ever really get worse.
If I ever need to pay for it, it will likely be to shift some of the capacity into the cloud for either business or pragmatic personal reasons (so I can just carry an iPad etc.)
I fully intend my expenditure to be negligible. Because once one realises that outspending others is impossible, only spending minimisation makes sense.
I foresee it potentially making sense for me to move some mature tools off a local LLM to openrouter, maybe. But probably to the same or similar models.
I spend 30 - 60 bucks a year with Horizon Labs.
I spend 25 bucks a month on Cursor. Cursor replaced an OpenAI sub.
Both support hobby projects. If either cost increased I would spend some time testing local alternatives and probably drop them.
Horizon Labs especially, I know that they have been matched by open models and are mostly a convenience at this point.
If I were really forced to.
LLMs provide me about the same value as a car does.
We have benchmarks on our domain and it does there are models that are 2x to 10x cheaper for a small drop in percentage points in accuracy
How many months is this car loan? What was the down payment? What's the interest rate? We haven't even asked what kind of car it is yet.
When I bought my last GPU, running AI models locally was a consideration though not the only one, and I have it set up but haven't used it much yet. I mostly use the free tiers of ChatGPT or Google to write the occasional script for me. I guess they're going to have to inject a truly unfathomable number of ads to get their money's worth.
I have a feeling my experience is closer to an average persons' than a dev, but it doesn't seem like they'll be able to monetize just from devs even if each one is spending thousands a month.
Don't give up just keep trying you can truly build personally life changing things. Don't look at it purely from a how do I sell this lense, just empower yourself with these tools while the getting is good
AI is so important, I want to have it under my control. Even if I have to pay a penalty in terms of capabilities.
If AI allows me to cut my time to do something in half on average or allows me to do 2x more it would be worth it to pay up to what my monthly income was before assuming my income scaled with my output.
The problem is that hasn’t been the case for 50 years
For work, it depends, but if I have to spend more than a few hundreds bucks probably I'll start looking for alternatives (local models, Chinese providers, ecc)
PS: I'm in Italy, I guess in several parts of the world these figures are even smaller.
Maybe it’s just your phrasing but people will only pay for what works, no one is loony enough to support a trillion dollar industry out of the kindness of their heart or spirit of innovation
It may put me at a disadvantage when it comes to quickly slop something together? But so far the free-to-use chat bots do as well for my needs.