This supercomputer is surprisingly underwhelming, since it's equivalent to just two of Google's TPU v3 pods.
The 200 petaflops number of Summit is referring to general purpose double precision computation. This is totally incomparable to anything the TPU can do at any performance.
> Built for the U.S. Department of Energy, this is a machine designed to tackle the grand challenges of our time. It will accelerate the work of the world’s best scientists in high-energy physics, materials discovery, healthcare and more, with the ability to crank out 200 petaflops of computing power to high-precision scientific simulations.
EDIT: OK, it's 200 PFLOPs of high precision math, 3 EFLOPs of lower precision math. I take my comment back.