I have not experienced this "llms dont write maintainable code narrative" I just tell it the shape of the entities and apis I want vaguely and the mental model and the output is excellent.
I think for refactoring, you're definitely right as if you give them a good high level sketch you can get them to do all of the more tedious implementation.