Hacker News Reader

Comment by joe_the_user | Hacker News Reader

I didn't go into it trying to break or trick it. The only thing tricky about the questions I asked was that I knew the answer to them. I don't think it's necessary dumber than the first page of a Google search but it's certainly not more well informed than that. But it certainly seems smart, which is actually a bit problematic.

View on HN

It’s actually not that different from chatting to the know-it-all type of Internet rando: they can talk to you about anything and seem knowledgeable on all of them, but go into a topic you actually know about and you realize they’re just making shit up or regurgitating myths they read somewhere. You can find that kind of user on HN.

Yeah this is my main concern about GPT-3, there's no truth-fiction slider, and it will often slip complete fabrications into the output, making it dangerous to rely on for real world information. Which is really a shame, because it does actually give great output most of the time.

Why is this a special concern about GPT-3? I cannot think of an institution, entity, or tool about which those statements are not true.

Replace "GPT-3" with "Hacker News posters" "Wikipedia", or "News broadcasts" to create three more 100%-accurate paragraphs.

I have never seen a human made website with a truth-fiction slider. The answers can be straight up false and scary, but it is no different from other publications out there.

Even with the most credible news sources, it is still up to the person reading it to sense the BS.

I never believe in natural lang to tell computer to do things with an objective of getting certain result (been skeptical since pre-2011).

It wouldn't be used to fly plane without lots of physical buttons as a fallback.

Composing rigid instructions for computer is already hard, even with precise semantics defined. Even with static typed, dynamic typed, developers will try hard to get rid of a single bug.

AI will serve as a middleware with an objective of arbitrary result.

  Human
  |> UI (request)
  |> AI
  |> UI (response)
  |> Human
  |> UI (request with heuristic)
  |> Computer does thing

Okay, so what is the best race to play as a druid? Now you have to prove that you are not the chatbot, Mr ChatBot.

It’s a technical preview, not a finished product. If they’d tested it on every combination of Kerouac novels before release, it would probably never see the light of day :) I’m still incredibly impressed.

Reply on news.ycombinator.com