Working in a closely related space and this instantly became part of my team's onboarding docs.

Worth noting that a lot of the visualization code is available in Github.

https://github.com/3b1b/videos/tree/master/_2024/transformer...