> LLMs are also getting to be pretty old. BERT and GPT-2 are both more than 5 years old
You sound like you have no clue that five years are the blink of an eye.
You sound like you have no clue that five years are the blink of an eye.
Cryptocurrency apologists also used this line of logic. "Yes, today the value of crypto is nothing... but imagine where it will be in five years!" Then we all wait 5 years, and cryptocurrency is still the victim of it's own mindset. Like cryptocurrency, I think LLMs have "technically" solved what they set out to do; generate readable text. But you need more than a solution in search of a problem; there isn't really that much demand for marginally truthful text in the same way completely decentralized currency isn't really necessary for the average well-meaning civilian. I'd even go further and argue that introducing AI into our daily lives requires you to replace something else, something that was probably more accurate and better-designed than the AI replacing it.
If 5 years is a "blink of an eye" for the industry, the entire field will be dead within 18 months. VC just moves that fast.
You clearly have some very specific models in mind. Even if the latest 4B and 8B models don’t move the needle on the “results you would champion” metric, this does not advance your argument that the state of the art hasn’t significantly progressed from 5 years ago.
> I would legitimately argue
I’ll bet you would!
Because this to you is "generate readable text"?
https://m.youtube.com/watch?v=MirzFk_DSiI
Sorry to be so direct, but you're in denial.
There's a reason why GPT-4o is not taking over YouTube and social media with it's incredible capabilities; nobody cares.