* walks past gnabgib's desk
"Good morning!"
"Who are you talking to? Me? You haven't specified who you're interacting with. Which morning? Today? What metric are you measuring by good? This is too confusing for me."
The original article title is:
> $2 H100s: How the GPU Bubble Burst
Either AI is super dead, or a new alien GPU rained from the sky
I think AI is not gonna die even in its current stocastic parrot incarnation. It is a useful tool for some tasks and, albeit not transformative like some CEOs, I believe it's gonna stay.
At most I believe we will enter another AI winter until there's the next algorithmic breakthrough.
There's also cheaper NVIDIA L40/L40S if you don't need FP64.
Here's one for ~$18 inc shipping with 6GB DDR5:
https://www.ebay.com/itm/Nvidia-Tesla-K20X-6GB-90Y2351-C7S15...
That said, could I see them being offloaded in bulk for pennies on the dollar if the (presumed) AI bubble pops? Quite possibly, if it collapses into a black hole of misery and bad investments. In that case, it’s entirely plausible that some enterprising homelabs could snatch one up for a few grand and experiment with model training on top-shelf (if a generation old) kit. The SXMs are going for ~$26-$40k already, which is cheaper than the (worse performing) H100 Add-In Card when brand new; that’s not the pricing you’d expect from a “red hot” marketplace unless some folk are already cutting their losses and exiting positions.
Regardless, interesting times ahead. We either get AI replacing workers en masse, or a bust of the tech industry not seen since the dot-com bubble. Either way, it feels like we all lose.
https://www.reddit.com/r/nvidia/comments/1fw68rl/retiring_a_...