Largest AI model to ever be trained on a single device

Does anyone here know how this giant "system on a chip" compare to Tesla's DOJO "composable fabric" infrastructure?