Yes, see also the transformers library containing many transformer models in pytorch