Housing prices have gone up a lot even in places with low immigration and low population growth.