While I do agree there will be disruption we haven't seen yet, my company is already spending >$40k/day for a "frontier model", so who knows. Then again, they're not using that for coding
What are they / you using it for in such quantities?
I know that some companies are spending around that much per day per engineer. They just want to go as fast as possible.
They're spending $10 million USD per engineer on LLMs?
Sorry, I meant per month, not per day.
40k per engineer per month? ~1.3k per day?
AFAIK it varies per person but it's around $20-$40k per person per month. Just lots of Opus working on multiple features in parallel all the time, even overnight.
My team (ML team) is using about 2-3k per day per person on a team of 9