Hacker News Reader

Comment by Mizza | Hacker News Reader

Does anybody have their hands on it? Is it actually 6 times better at performing tasks, or are we paying more for improved corporate-friendly bumper bowling?

View on HN

Not the API, but if you pay for ChatGPT Plus you can try it out there.

It's very, very impressive so far - I've tried a bunch of things I've previously run against GPT-3 and got noticeably better results - maybe not a 2x or 6x multiple in "quality" (depending on how you measure that) but still very clearly improved.

Posted a few examples here: https://fedi.simonwillison.net/@simon/110022949941148725

Thanks for the reply. I'm not all that impressed by "what is"/information retrieval tasks, is it any better at "thought" tasks like explanatory reasoning and ideogensis? For instance - "How might an agoraphobic kleptomaniac satisfy both of their desires simultaneously?"

That's a tough question even for me. The answer it did give me was to steal something online. Which was better than anything I was thinking. What did you have in mind?

Ah, interesting! It's a tough question and not one that has an obvious answer, which is what makes it a good test, it requires a little creativity. In my tests, ChatGPT/3 can't/won't answer it.

GPT-3.5 for me also didn't answer the question, and also gave me a MUCH longer response. I guess score a win for GPT-4.

I tried again with the new ChatGPT update released today (not GPT-4), and with some coaxing it suggested using a drone to go out and steal while staying at home. Not bad.

Steal from a friends house?

You'd still have to go outside to get to said friends house.

I think GPT4 gave the better answer here.

Those coffee puns are surprisingly good.

It's difficult to be sure exactly what six times "better" means, but I wouldn't expect something to have to be six times better necessarily to be six times better to be six times more valuable. I wouldn't expect a pitcher making $30MM/yr to be 6x better than one making $5MM/yr, but I could buy that they were 6x more valuable to have on your team.

If you've used Bing Chat, you've used GPT-4: https://blogs.bing.com/search/march_2023/Confirmed-the-new-B...

Bing Chat is more useful in many cases because it provides references that connect to it’s responses. I don’t like the mobile UI and that it doesn’t save your chats for you. Maybe I should try the web interface.

heavily lobotomized version of GPT-4

GPT-4 has a knowledge cutoff from 2001. Bing can talk about current events.

You mean 2021.

2021*

In my anecodotal experience, GPT-4 is at least a million times better than GPT-3.

It's like night and day.

How are you trying it? I’m ChatGPT Plus subscriber but don’t see any change.

You should have the option when you start a new chat to use default or 4

Yes now it gave me that. Not sure why it didn’t before.

In what contexts is the difference the most stark?

Reply on news.ycombinator.com