> I believe both stories are wrong, and wrong for the same reason. They assume the future of research belongs to whoever has the most GPUs.
As a current grad student in an mlsys lab, the sentiment is definitely true. However, I think the root cause is almost certainly not the lack of GPUs in academia, at least it's not the complete reason. The problem is the most important innovations really come from the industry right now. If you want to work on LLM inference serving, it is the frontier labs or hyperscalers that have the most incentives to solve the problems because improving the TPOT by 1% can save them tons of money. It is also much easier to catch up with the fast-growing field if you are in the industry because you get to talk to so many insiders (at least that has been my experience during the summer internship).
Papers only amplify this problem. Traditionally, academia is supposed to work on radical ideas that industries don't want to try. In recent years, these ideas are harder to get in as papers because the quality of peer review at top conferences is awful nowadays.
I'm not even going to talk about the AI slops in research papers and their artifacts. Guess why I'm posting on HN right now instead of working?
Finally, it's very disappointing to see that a professor at top school is so careless about editing stuff created by LLM. He might be busy, but the number of people that get discouraged by the LLM writing style will hurt his purpose of promoting the open source week. And apparently some people from industry had a better sense of that [1]. Yet another example of why some people prefer industry to academia these days.