Where it gets shouted down is from old people that have lived in their homes for 50 years and seen their property prices rise to make them millionaires on paper but with no real income. They claim its unfair to force someone from their home.
Having studied Alzheimer's disease, it's easier on the mind to live in one place for the majority of your life. Being forced to move later in life can be traumatic.
Once you start taxing capitol you'll end up with no more overpriced valuations, conservative banking will be back in vogue.