To some extent this already happening. Many people moved out of the city during the pandemic. The people in desirable rural areas aren't necessarily happy about it. They are often upset about all the outsiders with more money moving in.
They probably wouldn't be very happy with their property taxes going up either? When there's increased demand for land in a certain town from newcomers, there should be higher land taxes for everyone according to Georgist theory, to keep the price of land zero.
Under a georgist system there is no such thing as real estate speculation. Real estate there doesn't cost multiples of peoples' net worth and increase of land tax rate is hardly noticed because the base value of land is a number hovering close to zero. Price for land and tax rate in that system is just an allocation mechanism of geographical area to the most productive use, preventing hoarding. In other assets where hoarding is risky, since inventory can expire (groceries) or go bust (stocks, bonds), speculation by holding inventory is valuable because it provides liquidity to other market participants. Speculation in land is pointless The land is always there and will not run away. The speculators are just pocketing private taxes that otherwise government could've collected and reallocated elsewhere.
We see this historically in frontier towns that had absolutely no limits on sprawl (as land on the outskirts was available to anyone willing to stead it) but still had city centers develop and usually to the construction limits of the time.
How does this mechanism work in concrete terms? My understanding is that Georgism advocates raising taxes on people with property in desirable locations. They decide they can't afford the taxes, so they sell to a developer, who tears down the house and builds a bigger building.
Another name for this process is "gentrification."
The difference is that with the way gentrification works currently, the developer pays the previous property owner lots of money, which isn't so bad. With Georgism, the previous property owner doesn't get anything, because the property tax is so high that the land isn't worth anything. It's similar to being a tenant in a rapidly gentrifying area where rents go up but there's no upside for you.
I guess if you're pro-density and don't own property, that might seem appealing, but this mechanism seems likely to be very unappealing to home owners.
Gentrification is primarily a problem with the current system. I can easily imagine an economic system that decentralizes economic activity akin to Distributism which will make it easier to rebuild and improve run down communities without having to move somewhere else.
You have a 500m^2 plot of land. This plot pays $50k land value taxes. If one person lives on the land that person pays the full tax. If 10 people live on the property they each pay $5k taxes per year. If 50 live there then the tax is $1k.
Property taxes scale with the building so housing more people means higher taxes. That is being avoided by only taxing the land.
Alternatively, people hate taxes, they want to avoid paying taxes. If you want to avoid land value taxes, the only way to do that is to use less land more efficiently.