There are ways around this. For example set a property tax from second home on. Do not tax the primary residence. Or set income brackets. If poorer people live in their own homes they don't pay property tax.