I suggest looking into Nvidia's DGX and DSX systems. Basically, everything of a data center except for RAM+SSD comes now from Nvidia as a vendor.

Nvidia's margin is so high because they deliver way more than just a GPU.