It's understood that LLMs have limitations and people are working on "the next thing" to try and make it to real AGI, e.g. Yann LeCun.
And they have failed every single time.
The bitter lesson essay was written precisely to dismiss that approach, which used to dominate conferences and scientific publications of the era. A general learning system, given sufficient computation power, will always outperform specialized crafted systems in the long run.
Think of it like this: if a world model is a useful abstraction, the general learning system will create it by itself during its training, without us needing to implement it by hand. This is the bitter lesson. And it comes for us all.