That’s datacenter compute for you, and they’ll sell a bunch of them. One simple reason (of many) - a lot of enterprise licenses are tied to CPU count and those licenses can be extremely expensive. You can save money on the licenses by buying fewer, higher speed CPUs, and in many cases it can offset the increase in CPU cost.
> a lot of enterprise licenses are tied to CPU count and those licenses can be extremely expensive.
if this pricing system is making an inefficient market for cpus then maybe it could be disrupted somehow
Go disrupt Oracle and see how that works out.
It's less expensive than the public price of the biggest Genoa-X with 1.15GB of L3 : 9684X at $14k+.
That's high end Xeon for you. At least here you can argue it can save you from buying a GPU.
NUMAAF I guess, but it doesn't seem like they did anything interesting with it yet.
Ouch, that's about the same as two A100s, any idea how it would compare?
If you buy 40GB A100s, maybe, but LLMs have pushed the price of the 80GB A100s in the same range (they're more expensive now than at launch(!)).
While the title bizarrely references GPUs, this is a normal general computation CPU that has 64GB of very high speed memory on the chip itself.