Hacker News Reader

Anyone know why they trained on TPUs? My understanding is that the main benefit of a TPU is inference. Is this not true?

The first generation TPUs were focused on inference. Second generation TPUs are focused on both training and inference.