Hacker News Reader

Comment by diggan | Hacker News Reader

According to Tom's (https://www.tomshardware.com/pc-components/cpus/amd-pushes-r...), those are supposed to be laptop CPUs, which makes me wonder what AMD has planned for us desktop users.

View on HN

If I remember right, in the press conference they suggested desktop users would use a gpu because desktop uses are less power sensitive. That doesn’t address the vram limitations of discrete GPUs though.

True but try to find a 96GB GPU.

H100 NVL is easily available. It’s just that it’s close to $20k.

It is actually much more expensive than 20k. I can find them between 25-30k only.

My bad. Looks like it’s $29k at the local store.

This drives me insane.

PC Part Picker, DDR5-8400 48 GB (2x24GB) is... $340 right now.

For $680 you can get 96 GB of very fast RAM.

How about someone make an NVidia GPU with 96 GB of RAM at a reasonable price? Please?

I totally agree that we should get higher vram sizes on GPUs but they are not the same as DDR5.

The one you listed does around 50Gbps. A really good gpu does almost 450Gbps. Prices as you know also don’t scale linearly. For something twice as good sometimes you pay 4x the price and so on.

This is a really important point. The architecture and the bus ram is connected to is also very different on on a discrete card than it is in a cpu. Each compute unit needs dedicated bus width connected to dedicated memory. So for most GPUs you can double the ram, but you couldn’t just add the equivalent of a stick of ddr5 because it wouldn’t match the dedicated bus

IIRC it's a market segmentation thing

That high price tag is most often attributed to the type of memory being used which in the H100's case, is HBM2e and error correcting.

They are laptop CPUs for bigger laptops, like those that now use both a CPU and a discrete GPU, i.e. gaming laptops or mobile workstations.

It seems that the thermal design power for Strix Halo can be configured between 55 W and 120 W, which is similar to the power used now by a combo laptop CPU + discrete GPU.

Reply on news.ycombinator.com