ChatGPT is coming soon to the Azure OpenAI Service | Hacker News Reader

ChatGPT is coming soon to the Azure OpenAI Service

twitter.com

29 pointsjdorfman13 comments

Is it though?

In a way that we care about, or in the “we can use it but you can’t” way that it is already there?

Given that currently the only way to access existing models is by filling in a request form (https://aka.ms/oaiapply) and “who knows?” … don’t hold your breath.

Saying the open ai service “is now generally available” seems like… a creative interpretation of the situation.

(Yes, I know they keep saying “generally available”, but if you actually try to use it you’ll see: “Azure OpenAI Service is available with limited access during the preview. Apply now“)

And to apply for the service, you must divulge your use case in quality. Because there is zero chance on conflict of interest with Microsoft‘s own plans.

To the comments here on pricing. It can be largely ignored. I strongly expect OpenAI understands that high cost is barrier to true, widespread, productive adoption in real world. ChatGPT successors will see cost optimisation as key.

By the time, world moves from exploration phase to productive one, a “production ready“ ChatGPT will be out with saner cost base.

Why is embedding ten times more expensive ($0.004/1K tokens vs $0.0004/1K tokens) than base models on Azure, but the same price at OpenAIs api pricing page (https://openai.com/api/pricing/)?

I think this is really exciting, I'm presuming a shared model and thus the price is reasonable.

I would definitely pay for more reliability. It’s a great piece of technology that I see myself using multiple times a day.

well 0.02 cents for 1000 tokens for davinci is already high I am not sure how affordable the new model may be

> well 0.02 cents for 1000 tokens for davinci is already high I am not sure how affordable the new model may be

Is it? I guess it depends on use case. Their site claims that a token is (on average) 4 characters, or roughly .75 words*. Let's say that's generous, and that a token is more like an average of .5 words.

The "Way of Kings" (according to reddit**, at least) is 383,181 words. So, roughly 766,362 tokens. $.02 gets you 1000 tokens, which comes to $15.33.

I dunno what you use it for, and maybe this isn't feasible for your use cases so take this with a grain of salt, but I personally would happily pay $15.33 to be able to send half a "Way of Kings" worth of words to ChatGPT and get half a "Way of Kings" worth of words in response. I mean, I'm certainly not typing half or even a third of the "Way of Kings" in a month to ChatGPT now, even though it's still free. *shrug*

Am I missing something?

* https://openai.com/api/pricing/#faq-token

** https://www.reddit.com/r/brandonsanderson/comments/cncrea/wo...

But usually it doesn’t really work like that, at least not for the cases I use it for. And chatgpt is even worse: it’s a conversational AI, so I burn 1000s of tokens fine tuning a response which will be slightly different than the previous response. With gpt3 I have the same issue: my products send a slightly improved prompt, based on the previous result to gpt3 and the new result improves. If you want automated quality, it’s rapidly becoming an impossible business model where humans or custom written software tools are simply (much) cheaper. And your clients know this because your competitors will offer them. It needs to become 0.001/1000 or less. It will do in a few years. It does, like you say, depend on your case. Many cases don’t need this much and there it is cheap, but those cases will turn out to be more demanding when the competition flares up with better results. You can easily burn a million tokens just playing around on an automated system connected to gpt3. Not many people want to pay $20 for just playing and testing things out.

The same happens with stable diffusion by the way; you need to generate many slightly different (improved) images from the same seed, maybe with inpainting to get to the final piece. That costs many tokens. High token prices as they are lead to (much) worse quality of the end result in sd and gpt.

All valid points- fair enough! :)

Strange that azure is going to sell gpt while openai is also selling premium api access in addition to the generally available apis for the same thing.

Doubly strange that pricing also differs.

(speculation) OpenAI monetisation objective, business model and cash flow situation etc. would be different to Microsoft‘s.

OpenAI has indicated interest in generating revenue because compute costs are “eye watering“

A side effect to this would be that it’ll offload a lot of chatGPT exploration traffic away from openai‘s chatGPT. That’s a good for OpenAI.

Reply on news.ycombinator.com