one of the best visual tutorials on the transformer I came across http://jalammar.github.io/illustrated-transformer/