The first generation TPUs were focused on inference. Second generation TPUs are focused on both training and inference.

https://www.blog.google/topics/google-cloud/google-cloud-off...