That's the purpose of the "public training set." You don't take an exam before reviewing the instructions on how to fill out the answer sheet.
The need for a huge training set to solve simple questions has never stopped bewildering me. I think to get a human-like intelligent model we need to figure out why humans learn from 2 examples and the models don't. But I don't mean to say that the current models aren't intelligent in their own way or aren't useful already.