Yeah, that was my conclusion too:
What’s a common response to the question “are you sure you are right?”—it’s “yes, I double-checked”. I bet GPT-3’s training data has huge numbers of examples of dialogue like this.
What’s a common response to the question “are you sure you are right?”—it’s “yes, I double-checked”. I bet GPT-3’s training data has huge numbers of examples of dialogue like this.
(Fortyseven is an alright dude.)
Asking people to be aware of limitations is in similar vein as asking them to read ToC
My point was a lot more subtle: if someone asks things like “double check it”, “are you sure” you can provide a template “I’m just a LM” response.
I’m not expecting the model to know what it doesn’t know. I’m not sure some future GPT variant can either