AI is just good at what it's got the most elaborate training data on. And by "good" I mean, is statistically most likely to spit something out that makes some kind of sense.

I don't know how well it is studied, but I suspect it is possible there is language-related complexity constraints to the effectiveness of the LLM algorithms. Like perhaps context-free grammar related problems with adequate training data can be more and more effectively solved, but maybe natural language related problems will not so much be effectively solved.

Would be curious if there is active research here.