Everyone has tunnel vision on LLM's like they are the only thing just because they are the latest big shiny thing.
"oh, they are at their limit". People were saying they were at their limit 5 years ago too.
There are a lot of AI techniques, some more advanced than LLM, just with other limitations so they don't look 'amazing'.
Seems like engineering at this point to tie them together for the next 'big thing'.