I gave a talk on using Google BERT for financial services problems at a machine learning conference in early 2019. During my preparation, this was the only resource on transformers I could find that was even remotely understandable to me.

I had a lot of trouble understand what was going on from just the original publication[0].

[0] https://arxiv.org/abs/1706.03762