Trillium, the sixth generation of Google Cloud TPU

Would love if these can be used outside the cloud. A new version of the Coral TPU would be nice to see.

coral tpu has absolutely nothing to do with the data center TPU.

I liked TPUV6 (as a name) way better..

Anyone know how this compares with latest nvidia?

Mmmmm.... No.

But I dug up this:

TPUv5e has 197 (bf16) TOPS (Tera Operations Per Second)

TPU V6 is 4.7x that, so...

TPU V6 is maybe 925.9 (bf16) TOPS

And I think I'm comparing apples to apples when I see this;

H200 BFLOAT16 Tensor Core 1,979 TFLOPS

So from my napkin calculations, Nvidia is 2x the raw flops... But I didn't compare memory, bandwidth, or power efficiency... Or cost.

H200 1979 TFLOPS includes sparsity, real one is twice smaller. So basically it’s on par performance to H200.