In that unlikely case, open-weight hosting providers (and Google and Meta and SpaceXAI) would pick up the slack.
The only chance of memory demand going down would be breakthroughs in model size reduction.
The only chance of memory demand going down would be breakthroughs in model size reduction.
So on the one hand you have all the sota model makers doing investor expectation management in saying wet need a slowdown for safety (may or may not be true, but also means they don’t spend on the next training cycle before IPO? Could be making their books look better too?) and on the other we have a sense that the models aren’t yet at the stopping place where we can just not train another cycle and use distillations of the current generation?
Source/citation?