There are explicit residual connections in a transformer block. Look up "residual connections" in Google images and you will see.