Yeah that's what I had in mind from the very beginning.
In fact I built a tool [1] that applies this principle for semi automated coding. It uses LLMs for generating code, but leave the context selection and code editing for human to complete.
I find this a sweet spot between productivity and quality of output.