I cant believe it simply use self-attention to generate one word at a time. It got to be more complex than that.