This might have been true 25 years ago, but all of South and East Harlem has been experiencing steady gentrification for the last decade. Most of that is coming from young families, from my experience living in South Harlem.
(There are lots of attractions to the neighborhood: old buildings, pretty side streets, good food, convenient access to museums, and one of the most reliable subway lines in the system.)