If you do a search for long term housing price data you will see that until the burst of inflation in the mid 1970s house prices were mostly flat. There was still inflation and wear, but the prices remained about where they were. In this environment where house prices are flat and houses wear out the asset becomes known for its depreciation.
The big thing about locales is their vulnerability. It really is the case that back then some undesirable people moving in to a community could start a cascade of people moving out. In that case prices went from flat to falling fast. If you really did pick a great locale then your reward was prices remaining flat.