Hacker News Reader

I totally agree that we should get higher vram sizes on GPUs but they are not the same as DDR5.

The one you listed does around 50Gbps. A really good gpu does almost 450Gbps. Prices as you know also don’t scale linearly. For something twice as good sometimes you pay 4x the price and so on.

This is a really important point. The architecture and the bus ram is connected to is also very different on on a discrete card than it is in a cpu. Each compute unit needs dedicated bus width connected to dedicated memory. So for most GPUs you can double the ram, but you couldn’t just add the equivalent of a stick of ddr5 because it wouldn’t match the dedicated bus

That high price tag is most often attributed to the type of memory being used which in the H100's case, is HBM2e and error correcting.

IIRC it's a market segmentation thing