What you're talking about is trivially within reach of GPT:
Automatic programmer: GPT-4 powered Github Issue solving with Pull Requests
Project
I've created a tool that reads Github Issues and creates a Pull Request to complete it. It uses GPT-4, of course. There are a bunch of reasoning steps the tool does, but it can be much, much better with better steps and prompting. It's just a Proof of Concept. I haven't even added Langchain, yet.
https://www.reddit.com/r/OpenAI/comments/11upow0/automatic_p...
And here's another: https://github.com/irgolic/AutoPR
You can keep shifting the goalposts if you want - "but the code will be buggy", "but it can only do simple stuff, doesn't understand the broader systems architecture" - but all indications are that, on a plug-and-play level, GPT is able, to at least some extent, to do what non-techies think of as "programming".
It seems you are also underestimating what non-technical managers can do. Yes, some are utter dunces and technophobes. But most are not and can run basic shell scripts and even know what "files" are.