Karpathy: hallucination is all they do in some sense

https://simonwillison.net/2023/Dec/9/andrej-karpathy/