HNHacker News
TopNewBestAskShowJobs

nielpen

13 karma · joined December 7, 2022

submissionscomments
nielpen··on What's the Least Impressive Thing GPT-4 Won't Be Able to Do
Oh 100% -- anthropomorphic bias towards AI is about to get really interesting, I'd expect. Especially if prompt engineering comes to be part of the job description for tech, which seems likely.
nielpen··on What's the Least Impressive Thing GPT-4 Won't Be Able to Do
Say "I don't know."

Back when GPT-3 was all the rage on the internet, I remember Kevin Lacker's "Giving GPT-3 a Turing Test" left a real impression on me [1]. Short read, but gets to the crux of the issue. GPT-3 is a (really sophisticated) statistical model, GPT-4 will be no different. Maybe it will showcase new emergent properties of LLMs, like GPT-3's in-prompt few-shot learning did. But the fundamental constraint of a statistical model optimized to a masking task remains -- they're really bad at introspection and confidence-assessment.

[1] https://lacker.io/ai/2020/07/06/giving-gpt-3-a-turing-test.h...