i dont believe this for a second. Inference margins are huge, if they stopped R&D tomorrow they would be making an incredible amount of money, but they cant stop investing because they have competitors.
its all pretty simple
its all pretty simple
I guess we'll find out in 2-3 years.
One user in particular ran up a $50k bill for 1 month of usage, while paying $200 for the month: https://bsky.app/profile/edzitron.com/post/3lwimmfvjds2m
Plenty of people are to blow through resources pretty quickly, especially when you have non-deterministic output and have to hit "retry" a few times, or back-and-forth with the model until you get what you want, whereby each request adds to total tokens used in the interaction.
AI companies have been trying to clamp down but so far unsuccessful, and it may never be completely possible without alienating all of their users.
5 million paying customers on 800 million overall active users is an absolutely abysmal conversion rate. And that's counting the bulk deals with extreme discounts (like 2.50 USD/month/seat) which can only be profitable if a significant number of those seats never use ChatGPT at all.