The title compares GPT3.5 (not ChatGPT) with GPT4. Although the question is: If ChatGPT can do almost anything GPT3.5 can do, then why is it priced almost 10x less? Is it because GPT3.5 is less "censored"?
ChatGPT is GPT-3.5; with specific fine tuning / chat-oriented training, and without customer fine-tuning (at least, currently) available. It’s the particular GPT-3.5 interface that OpenAI wants people to preferentially use, so the price structure artificially encourages this.
If it is in fact true, doesn't it fall into "false advertisement" category? That is, OpenAI using ChatGPT for demonstration purposes but then charging for an API that pretends to be ChatGPT but is in fact based on a much smaller model?
If so, it could explain some costs indirectly.
I am genuinely not sure what they mean, this is the timecode in the announcement: https://www.youtube.com/live/outcGtbnMuQ?feature=share&t=651
It seems to say that they use Be my eyes "to make the product better", so it could be humans in the loop during captioning, or maybe they are using volunteers data from Be my eyes as training set ?
Or it's completely opposite, and that Be my eyes is using the OpenAI APIs ?
My guess is that it is both ?
1) Cost
2) Function
I suspect ChatGPT is 90% a cost-optimized version of GPT3, and 10% a function-enhanced one.
GPT3 was the first major public wow-able model, and I suspect it was not running on any sort of optimized infrastructure.
you might have 10 million queries on this thing per day. if it's just 1c/query that's already $100k/day.