Yes, in theory all the people who refuse to reproduce will be gone and are replaced by the children of those who want to reproduce. Over the long term this problem will fix itself. However, I personally believe that the population will level out instead of keep shrinking forever until reproductive pressures fix the problem by force.