That's a bitter pill to swallow. Most of this is the cost of the Nvidia card, and the RAM.
It would be great if China had more lithography machine....
Graphics:
(...)
+$18,399 192 GB Dual NVIDIA RTX PRO 6000 w/ 1000W + 750W PSUs (non-refundable) +$37,239
Memory:
(...)
192 GB DDR5 3600 MHz (4x48) +$1,874
yup, 87.8% of $42,412 is just two GPUs and a PSU. Even RAM is less than 5%.Still, you're right, I have a 1200W PSU for a single RTX Pro 6000, cost ~500 something, so still the PSU shouldn't be that large part of the total budget.
But you'll find most household power sockets aren't actually rated for the kind of power these things draw at peak. If you go for a dual GPU you're going to want to sustain a higher current. Think washer / drier / fridge kind of hookups for the UPS and that rig.
You spent $42K on the rig, you're also going to need to get an electrician in and have the electrical hookup seen to. The single 4090 I'm running put me right up to that edge where I could use a standard electrical hookup with a 1000w UPS.
So another $1K for the UPS, and $500 worth of electrical work (or more if they have to up the switch to 200 amps, for example).
Not for the faint of wallet.
So you're right. If the $42K price tag didn't make you blink, the additional $2700 in tax, and the $2K to $3K for the work in your house are going to financial hiccups. But it means the cost to start is $50K, not just the price tag.
Wish I built this a few years ago!
That sounds like a contradiction.
/J
> 96 GB Dual NVIDIA RTX PRO 5000 w/ 1000W PSU (non-refundable) +$19,169
Though I don't think there's anything stopping you from trying to stuff an H100 into this machine if you want to BYO.
Depending on your use case, you might prefer native FP4 and FP6 low-precision support and 5th-generation Tensor Cores rather than what Hopper offers.
I think for training Hopper makes sense as it's generally a bit cheaper and the difference isn't that big, but for inference the difference widens a bunch makes a lot more sense to go with Blackwell.