If he didn't understand the question how could he know the model answered it perfectly?
If he didn't understand the question how could he know the model answered it perfectly?
It makes selling improvements fairly hard actually. If the last model already wrote an amazing poem about hot dogs, the English language doesn’t have superlatives to handle what the next model creates.
If we are being pedantic we could never accept "question we don't know how to answer" as a possible interpretation of "question we don't understand".
Also, 'thing that I don't know about but is broadly and uncontroversially known and documented by others' is sort of dead center of the value proposition for current-generation LLMs and also doesn't make very impressive marketing copy.
Unless he's saying that he fed it an unknown-to-experts-in-the-field question and it figured it out in which case I am very skeptical.
But more seriously - it's a ridiculous statement to think you understand the answer when you don't understand the question in the first place..