LLMs are “taught” two kinds of “truth”. One is 100% adherence to a reference text. If the text says the Coliseum is in Antarctica or 1+1=716, model must too. The other is adherence to reputable outside sources.

Not sure if it’s embarrassing or a fundamental limitation that grooming and misunderstanding satirical articles defeat the models.