Ah, now having the best model be expensive to use, and thinking the cash burn of both companies is insane and unsustainable I completely agree with. This, I think is likely the biggest reason they’re asking for government intervention and regulation: to help them weather the coming investment/cash plateau, not because the models are nearing any asymptotic limits. To be fair, there is an argument to be made that the improvement in models is tied to the cash burn; if they can’t train bigger models or acquire more data or research more effective harnesses, then the improvement of
their models might slow down - while GLM or other models continue to improve.
I’ve never thought LLMs were on the AGI path, but I have to admit it’s surprising how far it’s come with no end in sight yet. There is something important to be said about how ‘intelligence’ is embedded in language, and it suggests that intelligence isn’t exactly what we thought it was. The language component of intelligence also goes a long way to explaining technology’s progress in human civilization; how language and the printing press and mail and radio/tv and the internet have each ushered in accelerations in the pace of progress. Biologically and evolutionarily speaking, it’s unlikely that humans have become any smarter in the last two thousand years, but technology (among other things) has exploded.