These are gaming cards. If you think AMD is lacking here with just 16GB I can only assume you never bought NVIDIA gaming cards in the last 10 years.
What's with the P40, CUDA and fp8? Seriously people, chill. AI has been using graphics cards because that was the best available route at the time, not the other way around.
Otherwise I must question, why don't you talk about DisplayPort2.1, DirectX12, FidelityFX.. and other dozen features graphics related.
My rig is 4x4090, and it did cost a fortune to me already (still less expensive than a single H100). I would have happily used cheaper AMD cards, but they are not available for reasons like this.
Last time I checked, this site was called "Hacker News", not "Bigtech Corporate Employee News".
Graphics cards have been for more then running games even before they were broad-purpose computer engines that they have been since NVidia radically reshaped the market—decades ago.
Heck, Nvidia has had multipe driver series for the same cards because of this, even before AI was a major driver.
Then do that instead if it fits your workload?
There's more to a video card than the amount of RAM, though.