Gemini and Gemma were trained on Google's TPUs.