Terry Tao: "LLMs Are Simpler Than You Think – The Real Mystery Is Why They Work" [video]
youtube.com
youtube.com
My personal conclusion - most of us are really just not as intelligent as we think.
AI isn’t smart. We’re just dumb.
The LLMs seem smart because they were trained on the intellectual content generated by smart people.
An LLM trained only on 4chan would be very different…