Probably only once the property starts voting.

As it stands, residents can do lots of things to make outside ownership unpleasant, at least, once/if they decide that is the best course of action.

(I recall someone mentioning that property owners are the voters somewhere in or around London, but there were close to 0 residents there)