Hacker News Reader

No.

There are plenty of research directions that are outlined in this document that don't require huge compute budget.

Much of the interesting pure research can be done at smaller scale, the larger models are arguably more product engineering than research. At least from a certain perspective.

That is not a problem. There are literally thousands of ways to conduct any experiment at the fraction of the cost.

Thanks. Whenever I think I want to run something on a cluster of A100s, I'll just remember the thousands of ways instead, and train my LLMs that way. There's a reason why humans didn't need computers until just recently, after all. I must be so blind to not have seen this earlier.