You can't spend your way out of the latency issues associated with such a distributed architecture, though.

That's one of things NVLink helps with, actually.