Isn't the energy consumption of this technology pretty catastrophic? Do you consider the issue of energy consumption so abstracted you don't worry about it? Do you do anything to offset your increased carbon emissions?
There is about zero chance OpenAI are running their service at a 70% negative gross margin.
The math just doesn't work. They're hemorrhaging money as far as I can tell (not counting the Azure computing deal).
We can only guess, but my guess is that inference is still a good chunk of their costs. That's why they're trying to get the mini/turbo models into a usable state.
Even then, training is still an expense. And it's not like you can train and forget. Even if your model is already trained you still need to incorporate new knowledge over time.
Yes. Quite a lot. I walk the talk.