It might be more of a Linux problem than a chip problem…
NVIDIA already lowered power draw at idle by 18W with a currently out of tree driver leveraging PCIe hotplug for the NIC earlier this year.
I think that quite a bit more people bought those to use them without the ConnectX than what NVIDIA expected.