>Progress in LLMs has come much more rapidly than expected
I hear this very often, but I'm not sure, what were the expectations 10 years ago? What are the expectations for the next 10 years?
I hear this very often, but I'm not sure, what were the expectations 10 years ago? What are the expectations for the next 10 years?
"We downloaded the raw Latex source file (a 16MB file) and trained a multilayer LSTM. Amazingly, the resulting sampled Latex almost compiles. We had to step in and fix a few issues manually but then you get plausible looking math, it’s quite astonishing:"
My emphasis.