How might LLMs store facts [video]

Loved the part at the end of the video about the Johnson-Lindenstrauss Lemma. Really great visualizations of how high dimensionality can encode so much information.