One of the major benefits of TF 2.0 is apparently the capability to quickly deploy to TPU units with a single parameter change. (I haven't tried it, just followed the marketing).
AFAIK, This is still being worked on PyTorch via XLA, but not quite there yet.