LLM progress is likely going to have a deteriorating curve like nearly all ML / AI tech.
It's possible things aren't going to get substantially better from GPT-4 for a while.
The idea that new players will surely zoom past seems bold, especially when established incumbents with massive budgets and proven track records in the space are struggling to keep up...