What Is NVLink? And How Will It Make the World’s Fastest Computers Possible?
blogs.nvidia.com
blogs.nvidia.com
Is NVLink attached to the northbridge, or is it a replacement for the northbridge? Is the northbridge even a thing in computer architectures this large?
Currently PCIe can talk directly to the memory controller, and have direct RAM access without CPU overhead. So the whole GPU's run as fast as CPU's can give them memory is a bit false (but since memory controllers are on chip now I guess its true?).
What this maybe, if I had to guess. Is dynamic lane allocation. Where 1 GPU can free its PCIe lanes to let other devices use them. So 1 GPU can use all ~90 or how ever PCIe lanes IBM power9 chips have, instead of 4 GPU's each having 22.
For an example of what the signaling might look like, see https://research.nvidia.com/publication/054-pjb-20-gbs-groun...