Did I miss it or did they not say how much it costs?
$13,744.95
I think AMD could theoretically make a 96GB inference card this gen with their modular memory controller...
This is 2xGPU, and two very expensive GPUs with HBM.
I was thinking they use the 7900 XTX die, and swap out the tiny memory controller dies or somehow double them up (which is infinitely cheaper than redoing the whole big die). They could massively undercut the L40 in cost while still doubling up the vram to 96GB, and doubling the bandwidth as a happy side effect.