3Blue1Brown's youtube channel has a lot of visualizations that may help. Transformers are video #6 in his neural networks playlist: https://www.youtube.com/playlist?list=PLZHQObOWTQDNU6R1_6700...