here is another interesting link explaining the reference architecture across 256 nodes and 24 racks:

https://www.anandtech.com/show/18877/nvidia-grace-hopper-has...