What's with the P40, CUDA and fp8? Seriously people, chill. AI has been using graphics cards because that was the best available route at the time, not the other way around.
Otherwise I must question, why don't you talk about DisplayPort2.1, DirectX12, FidelityFX.. and other dozen features graphics related.
My rig is 4x4090, and it did cost a fortune to me already (still less expensive than a single H100). I would have happily used cheaper AMD cards, but they are not available for reasons like this.
Last time I checked, this site was called "Hacker News", not "Bigtech Corporate Employee News".
Graphics cards have been for more then running games even before they were broad-purpose computer engines that they have been since NVidia radically reshaped the market—decades ago.
Heck, Nvidia has had multipe driver series for the same cards because of this, even before AI was a major driver.
Then do that instead if it fits your workload?
There's more to a video card than the amount of RAM, though.
And the power connector melts if you look at it funny.
16GB is great for what these are: Gaming cards.
Even on the nVidia side you have to spend $2000 (likely more) to get more RAM than that.
You could buy 3 of these for the price of a single nVidia 5090.
nVidia created the AI chip market on the backs off gamers, but that doesn't mean that trend will continue forever. The demand is there, so they can extract greater profits and margins on AI chips.
Since Nvidia dominates the AI market anyway, AMD has the opportunity here to not try and help them protect it, and sell cards with more RAM. IMO that’d be a good move. They’d be keeping gamers happy by not hampering their product artificially. And, some poor grad students might use their cards to build the “next thing.”