LLMs excel at programming–how can they be so bad at it?

This seems to hit the nail on the head to me