Simple solution would be to put a property and sales tax ramp on additional homes. Make landlords who own N homes pay 1.5^N the normal rate.
Since you asked, another idea would be to slap a vacancy tax on top of this.
It's the same equation as crypto mining, as long as there's a return on investment they will continue to buy up GPUs.