I was just trying to point at that local governments are also encouraged to have high property values for tax revenue. They also tend to have a bit more power to be able to affect large areas property values by force. If people cannot/don't utilize the government to enact policies to force people out, it seems to me that it would be pretty difficult for people to enact those policies without governmental power.

What we see in places like San Francisco are property owners and governments teaming up to drive property values up in a mutually beneficial relationship.

Edit - It could be said that the government itself is rent-seeking in such an arrangement.