PyTorch is the most used neural net framework in research. Almost everything appears in PyTorch first.

Yes, see also the transformers library containing many transformer models in pytorch

quite easily, yes