Jensen aims to charge more for more GPU computing power into the future.
This is because Nvidia has close to monopoly power this is able to break Moores Law single handedly.
Jensen aims to charge more for more GPU computing power into the future.
This is because Nvidia has close to monopoly power this is able to break Moores Law single handedly.
IMO if Intel stay in the game it’ll be sorted out within a few years.
Nvidia may have good software but people like paying less money.
Paying less will win out.
Unlike in gaming in the data center initial cost + performance per watt are the only thing that really matter (besides software, Nvidia has a huge moat there..). And in relation to how much Nvidia is charging per GPU total power costs are close to zero.. So 4 ‘worse’ but much cheaper chips might be a better deal than buying an A/H100 etc.
That's not true from a hardware perspective either. You can't just plug in 4 worse cards in the same rack. The savings on the graphics cards become less significant if you need to double/quadruple all other hardware to increase the number of racks. A 1U blade can easily cost $10000 without a graphics card.
For anything datacenter related, customers are very sensitive to price per performance. And datacenters are happy to oblige.
Of course data centers are happy to oblige to customer demands, but initial cost per GPU and performance per watt are certainly not the only relevant factors.
otoh it can be said that gpu's just look like they improved longer than cpu's because their workload is vastly more susceptible to parallelism.