not sure you can call it total speculation, it's a subject matter expert giving their opinion based on public knowledge. OpenAI has to solve how to improve their model while being limited by GPU capacity and seeming to be having diminishing returns in terms of model size. And that was before their CEO and president both quit/got fired
It’s not just speculation though, it’s based on what OpenAI has done since releasing GPT-4.
The promised “foom” just hasn’t happened.
it's a language model, not a foom model. nobody has made anything like a foom model yet.
Yeah headline should say the "called it" part of the tweet to make it clear this is speculation and was before the news today.