Hacker News Reader

Comment by capableweb | Hacker News Reader

> GPT-4 recently extended that to 32,000 tokens

Slightly unrelated, but has anyone outside of OpenAI got access to this model yet? While I received API access to GPT4 just a day or two after applying for it, I've yet to succeed to get access to the 32k version, nor has anyone I know, and I have not seen it being used by anyone in the wild either.

View on HN

I have access to it through Azure.

First you need to get approved for OpenAI access via Azure Cognitive Services: https://customervoice.microsoft.com/Pages/ResponsePage.aspx?...

Then you need to get approved for GPT4: https://customervoice.microsoft.com/Pages/ResponsePage.aspx?...

Once approved for GPT4, you'll have access to the GPT4-32k model.

Do you have any remarks to share?

With image input capability?

Unfortunately not

Are there other OpenAI models only available via Azure? I think code-davinci-002, the GPT-3.5 base model, is now only available via Azure. The GPT-4 base model seems to be completely unavailable. The OpenAI playground only has the old GPT-3 base model, davinci.

code-davinci-002 is the model used for code completions.

Here's the full list of models: https://learn.microsoft.com/en-us/azure/cognitive-services/o...

Yeah, it can be also used for that, but the Azure characterization is misleading. The fact is that code-davinci-002 is the GPT-3.5 foundation model, the naked token predictor without any fine-tuning applied to it. See

https://platform.openai.com/docs/model-index-for-researchers

This makes it a very powerful tool in general, since it doesn't suffer from mode collapse. It can be used for anything, though one has to prompt it right, since it doesn't follow instructions by default.

Ah, that's unfortunate, I've applied to get access to that a while ago but never heard back, while getting access to API GPT4 just took a day or something. Oh well, at least it does exist after all :)

Is it possible to get access to the base model (ie no RLHF) via Azure? Or even the version that’s part of Goodbing?

No, it is my understanding that even MS research employees do not have access to that anymore.

That's some sci-fi stuff right there. A model so bad that even your researchers aren't allowed to talk to it.

Reply on news.ycombinator.com