From what I’ve seen, LLMs are good at making stuff that has already been made and posted to GitHub a thousand times before. At my job we’re constantly asked to do things that really haven’t been done before, at least not by people sharing source code, so the LLMs suck at most of it.
LLMs make for great tech demos, but when it comes to writing code for production that actually does something new and useful, it hasn’t impressed me at all.