High end networking gear already has higher throughput:
http://www.mellanox.com/page/ethernet_cards_overview
https://www.servethehome.com/mellanox-connectx-6-brings-200g...
A SAN/NAS using the same PCIe 4.0 SSD's you mention could probably fill the pipes too.
... and it would probably need a bunch of network stack tuning. ;)
> High end networking gear already has higher throughput:
100GB/s > 200Gbps
You would need 4x 200Gbps ports to reach 100GB/s, so 2x MCX653105A-ECAT (each 2x 16-lanes) at > $700 each, and pay for 1/10th of a ~$30 000 switch, IOW 100GB/s would cost you ~ $4400, before paying for the storage.
Sure, it could be done, but it wouldn't be cheap, and you'll have used most of the PCIe lanes.
EPYC servers (128 PCIe lanes) would probably be the go too, not Xeons.
This is just Imagineering though. ;)
With the specifics, wouldn't it be 4 cards needed? Each card has 2x 100Gb/s ports, so 8 ports in total.
That being said, after re-reading the comment they're talking about adding multiple PCIe cards to a box to achieve 100GB/s of local total throughput.
That would be achievable over a network by adding multiple PCIe 200Gb/s network cards too. :)
As a sibling comment mentions though... the cost difference would be substantial. :(