>But OpenAI doesn't have tiny COGS: inference is expensive as fuck.
No, inference is really cheap today, and people saying otherwise simply have no idea what they are talking about. Inference is not expensive.
No, inference is really cheap today, and people saying otherwise simply have no idea what they are talking about. Inference is not expensive.
> Even at $200 a month for ChatGPT Pro, the service is struggling to turn a profit, OpenAI CEO Sam Altman lamented on the platform formerly known as Twitter Sunday. "Insane thing: We are currently losing money on OpenAI Pro subscriptions!" he wrote in a post. The problem? Well according to @Sama, "people use it much more than we expected."
Altman also said 4 months ago:
Most of what we're building out at this point is the inference [...] We're profitable on inference. If we didn't pay for training, we'd be a very profitable company.