Like the OP said "LLMs are bar none the absolute best natural language processing and producing systems we’ve ever made".

They may not be good at much else.