Google translate uses TPUs, and has done since they swapped to neural models: https://cloud.google.com/blog/products/ai-machine-learning/a...