If you ask LLM something you know you can distinguish noise from good output. If you ask LLM something you don’t know then how do you know if the output is correct?
There are cases where checking is easier than producing the result, e.g. when you ask for a reference.