This seems like a good flow! I end up adding a "spec" and "todo" file for each feature[1]. This allows me to flesh out some of the architectural/technical decisions in advance and keep the LLM on the rails when the context gets very long.
[1] https://notes.jessmart.in/My+Writings/Pair+Programming+with+...