They left as soon as it became practical to leave (introduction of cars and suburbs) because of crime. The crime rate back then was inconceivable to anybody living in America today.