Until urban centers decide to become more family friendly this will continue. Bad inner city schools, traffic, and no wonder families want to get away.
There are plenty of counter examples (mostly Asia). It isn't like this cannot be fixed, but without families nobody as arguing for family friendly things and so people move out when the kids come.