You hit the nail on the head here. The simplest way to solve this problem is a stepped increase in property taxes for home which are not the primary residence.
Just as an example:
Assume a baseline property tax level of say, 6%.
Primary residence - 2% discount to 4% Non-primary residence, in same region (county/city) as primary = 6% Non-primary residence, not in same region as primary = increase 2% to 8%
Non-primary residence owned by a corporate entity rather than a citizen = increase 4% to 10%.
You do that, it should make doing things like this much harder.
https://www.cnbc.com/2023/02/21/how-wall-street-bought-singl...