Yep, much like having access to a circular saw won't make me a carpenter, having access to an LLM won't make the average person a software engineer.
you're moving the goal post as language models and agents aren't marketed as something like circular saw but a team of carpenters that you just tell what you want and they do it for you.