The people who think an LLM or other type of model can do a job are the people who don't know anything about that job.
Managers who don't know what developers do think you can replace a developer with an LLM. Can an LLM shit out some code? Sure, but that's hardly what (good) developers do.
Magazine publishers who don't know what editors do think an LLM can replace an editor. Can an LLM make a bunch of statements about the quality of a piece of writing? Sure, but they may have no basis in reality and will require a real human editor to review them. Or your publication can succumb to being LLM generated slop.
Bad coders who don't know what good coders do see that an LLM can do what they've been doing and think developers will be replaced but they don't actually realize what it means to be a developer so they don't see all the things the LLM isn't doing.
Tech bros think a model will be able to revolutionize materials development but when actual materials scientists look at the output it turns out it's mostly garbage. And crucially it took actual materials scientists spending a whole lot of time to figure that out. [0]
Most of what these models do is waste actual experts' time by forcing them to wade through huge quantities of plausible looking but completely incorrect output.