H100s are available at increasingly affordable prices
The marginal cost of each chip is dollars. The 5 digit prices for H100s are just margins to be undercut
You can (and I think should), cut it out by going with coreweave, lambda, another or doing it yourself
I’m okay paying that huge margin to first tier cloud for CPUs and disks, which are cheap, but not GPUs
that's what's so corrosive about media coverage and stock-market speculation: it corrupts any actual price signals in the market.
there is not an infinite demand for AI training, let alone AI inference.