True. I'm not sure "done" is quite the right word. I think the problem is at that point you no longer have a useful training signal, so you have to stop.
You can simply use the detector network to discard faulty results in a pipeline and it's already useful