It takes $3k for Nvidia to produce H100[1], so the total for Nvidia will be $30m, not small but definitely not the most expensive supercomputer.

[1]: https://the-decoder.com/nvidias-h100-gpu-sells-like-hot-cake...

Less expensive. Big discounts exist.