The demand for memory isn't going to go down, we'll just be able to do more with the same amount of memory.
The demand for memory isn't going to go down, we'll just be able to do more with the same amount of memory.
Given that increasing model size doesn't yield proportional increases in intelligence, there is a world where these datacenters don't have a positive ROI if we make these models even a fraction as effective as the human brain.
I think that either investors were extremely skittish that the stocks might crash and jumped at the first sign of trouble (creating a self-fulfilling prophecy) or they were trading on non-public information and analysts who don't have access to said information are reading too much into the temporal coincidence of the Google Research blog highlighting this paper.
This paper was released a year ago and was probably part of how google got to 1m context before other labs.