How does a DGX Pod w/ the new 3.2Tbps per machine NVLINK switch compare to Tesla Dojo?
I don’t know anything about the state of Dojo, but Tesla was very hand wavy about their software stack during their presentation. And running AI algorithms efficiently on a piece of hardware is one of those things that many HW vendors have a hard time getting right.
NVIDIA DGX H100 (8x H100): 480 TF FP32 / 8 PF+ TF16 / 16 PF INT8 / 640GB HBM3 / 10kW
Dojo off-chip BW: 16 TB/s / 36TB/s off-tile
H100 off-chip BW: 3.9TB/s / 400GB/s off-DGX