Right now the US dominates everyone else in actual chips in data centers. So even if deepseek etc tries to undercut, they’re very capacity limited.
Right now the US dominates everyone else in actual chips in data centers. So even if deepseek etc tries to undercut, they’re very capacity limited.
It's that good. They are far from capacity limited, and even if they were, you can rent a single MI300X from somewhere like Hot Aisle and get more tk/s than you'll be able to use.
That one is dirt cheap at API pricing, I can't imagine quota is going to be a concern on the $200 subscription, which in my opinion easily supports full time use of 5.6 Sol on xhigh.
A couple of very talented friends were uttering curses upon the entire bloodline of whoever convinced them to try letting sol xhigh do serious work. Deepseek cleaned it up for a fraction of $20.
The cost per task was $0.03 with DeepSeek, $0.05 with Luna. $1.23 for Sol.
Tokens per second 132, 202, 70 respectively.
They also previously said prices will go down significantly once they get a hold of the upcoming Huawei chips (later this year).
Prices are going up just because they can. It can easily come back down. They aren't strained by some IPO / VCs requiring them to 1000x their earnings.