And what's amazing is that it was built on 28nm. So TPU 2.0 could increase by another 2x in perf/W just by going to 14nm (most likely) - even more if it's built on newer processes than that.
Intel's latest chips will be even further behind compared to the next-generation TPU than Haswell was compared to TPU 1.0.