You might want to check out Yann LeCun’s arguments—they’re pretty interesting. TL;DR: he sees LLMs as a dead end and backs that up with concrete examples.

https://www.youtube.com/watch?v=vJKC31YpA8c