It's a common argument here: "LLMs are overhyped, because they could not solve my super niche issue".

Their current status is basically "very junior programmer with a photographic memory, who has read a sizable chunk of the internet". They are excellent if you regularly need to implement code that has been done before.