Hacker News Reader

Comment by cube2222 | Hacker News Reader

I'd like to echo the GPT-4 sentiment.

Having used the API a bunch, the ChatGPT API (GPT-3.5-Turbo) feels like it has a 10-second attention span in comparison to GPT-4. GPT-4 is waaaay more powerful for actually building stuff on top of, adheres to your prompt in a much more stable way, and its reasoning is way less unstable in general as well. Writing long blocks of code without making "stupid" mistakes works much much better, etc.

The only downside is: it's so, so, soooooo slow in comparison to GPT-3.5-Turbo. You'll literally have to wait 2-3 minutes for the response with larger token amounts.

View on HN

Thinking fast, thinking slow

Is ChatGPT GPT4 equivalent to API version ?

I find both your statements confusing and I think they're factually wrong.

There's no "ChatGPT API". ChatGPT is a webapp. It lets you select between 3.5-turbo and 4 models in its UI.

There's an OpenAI API, which recently added chat interactions and suitable models. There, too, you can select 3.5-turbo and 4. AFAIK, the 4 served by the API is the same 4 used by the ChatGPT web app.

You may have missed the intro blog post for those APIs: https://openai.com/blog/introducing-chatgpt-and-whisper-apis

The title is "Introducing ChatGPT and Whisper APIs" and features quotes like "Snap Inc., the creator of Snapchat, introduced My AI for Snapchat+ this week. The experimental feature is running on ChatGPT API".

So, OpenAI refers to accessing the model powering ChatGPT as the ChatGPT API.

OK, gotcha.

Still, IMHO the OP post is misleading folks into thinking there's a magical GPT-4 that is not the GPT-4 you can also select on ChatGPT, but they are the same models. There's no GPT-4 that's better than ChatGPT's 4. I'm just trying to clear up this confusion for others, and frankly pretty surprised at the harsh downvotes.

There's also no separate ChatGPT API from the regular OpenAI API, I think the phrasing in the OpenAI page is just for convenience. But I'll grant their phrasing makes it canonical.

I see where you're coming from. I didn't personally get that from OP's comment, but I'm not a regular ChatGPT user and interact with GPT-4 mostly via playground or API.

Is that true? I was under the impression it was just like with the previous GPT models, where ChatGPT was an instruction tuned and pre-prompted setup designed for interactive conversations over the underlying GPT model you had access to via the API that was in its close-to-as-trained state of being a generative autocomplete.

I think it's true. See e.g. https://openai.com/research/gpt-4 making no distinctions.

Altman has stated in interviews they are considering releasing the un-tuned "base model", but they haven't done this.

For GPT-3, you can get models on the API via the "completion" end points (includes base models) and via the "chat" endpoints. For GPT-4, they've only released the latter.

So my point is: You can absolutely use ChatGPT to build an opinion on what GPT-4 is capable of. Arguably even better than on the Playground, as the ChatGPT frontend supports a bigger token window than the Playground frontend (8k vs. 2k). Of course the actual API supports the full token window (and if you're off the separate waitlist for this, even the full 32k). But it's still the same model.

There is a more "pure" GPT-4 model, and they're considering giving access to it. It's just not as useful to humans. Sam Altman talks about it briefly in the recent interview on the Lex Fridman podcast.

Yes, I know, but this is presently not available via the API. What OP here means is that someone's talking about 3.5 without having tried something with 4, while accidentally misleading people into thinking that there's a special 4 distinct from the 4 available on ChatGPT that can do more. This is not the case. If you've used 4 via GPT, there's not a different version somehow - that we know about! - that is more capable or useful. If your interactions with 4 were via the ChatGPT frontend, you don't need to revisit your opinions now.

> that we know about! - that is more capable or useful

There's some nuance that makes your statement not completely accurate, and Sam talks about it briefly.

ChatGPT is GPT-4 with additional training, and layers, on top of it. ChatGPT is more useful when used in a conversation mode, because it was trained based on how people liked the responses, in a conversation mode. Raw GPT-4 is harder to use, because it's not optimized for a back and fourth. It may be much more useful for other use cases, though.

I was thinking about this while writing earlier, and kind of made the leap that we haven't yet found a way to make the model more useful than the additional training (or at least it's not been published), so technically it would be accurate to say it like this. However, I certainly agree with you that there could potentially be other utility you could derive from the base model with alternate steps. I appreciate your comment.

It's called the ChatGPT API by OpenAI, and free users (ie almost everyone using the system) can only use GPT-3.5. There is no option for them to use GPT-4, which is behind a paywall and a waitlist (maybe the waitlist is done now, I haven't checked).

Reply on news.ycombinator.com