wait until the GPUs and data centers start getting written off for being obsolete in a couple years when we still have nothin but fancy auto complete.
Even if generative AI lives up to its hype, with current US administration there's no way America is going to lead the race for long. There's just not enough energy available, when those in power oppose developing many of the energy projects that make most economical sense.
right now I see even old GPUs like V100 are still popular. Maybe the old GPUs will shift to the countries with cheap electricity?
Assuming that GPUs power efficiency will increase, the same will be true about them.
IMO the most likely way to soak up the extra capacity is actually yet another iteration of AI rather than say, doing productive but boring work with any other techniques for curing disease or something. Still, a crash and a next iteration might be more likely to involve fresh ideas on architecture, or focus on smaller expert models that have less fake results and actually empower users. Right now I think there's a clear bias in research and execution. OFANG does want results, but also wants results that tech giants. Are subsymbolic techniques really the best techniques, or are they just the best at preserving the moat of big-data and big-compute?