> I don't know how well it is studied, but I suspect it is possible there is language-related complexity constraints to the effectiveness of the LLM algorithms.
I believe that's obvious - humans don't think in words. Neither do animals. A machine that only thinks in words is obviously going to be deficient in some things, no matter how proficient it is in everything else.