252GB of HBM3e at 100k vs. a multi A6000 96GB setup.
GB300 seem expensive in comparison at ~$100k. Am I missing something?
Basically it's the same as a tray in a GB300 NVL72, but in workstation/desktop form. Niche would be AI researchers.
They will... not sell a lot of these. But what a beast.
I am too lazy to price out 496GB of DDR5 but, um, mostly because it is terrifying to see what today's prices look like.
You can't build such a machine out yourself but if you could I suspect the price point would come out about the same.
That's kind of the nature of capitalism and price elasticity - the manufacture price only limited the minimum sale price, and sale price usually reflects how much is the market willing to pay for the good.
Where you might save a lot of money is on building something that's very targeted to your needs that matches them better than a GB300 workstation, for a lower price.
You could build out a complicated multi GPU setup of your own, but the work you do on inference tuning for your kernels etc would not necessarily translate to the real world.
But yes, if you just want to run GLM 5.3 on your own machine, that's a whole other story.
Exactly. It's tailor-built to be a GB300 tray under your desk. Unless you really need a GB300 tray under your desk, you would be better served looking elsewhere.
We could condition datacenter installs to providing power to the grid - you want to build a datacenter, you also need to build a wind or solar farm that can fully power its peak load.