> Nvidia ships a new architecture roughly every year, and the competitive life of a given generation is plausibly two to three years, while hyperscalers depreciate the hardware over five to six

I keep seeing this take about how GPUs are going to lose value and yet somehow they don't? Why is it that A100s (released in 2020) are still in high demand and fetching high prices? E.g. RunPod is still charging $1.40-$1.60/hr for A100s and making money. Lambda Labs is charging $2.00-$2.80/hr for the same GPU.