LA and Boston did this and now just have vacant high-rises to show for it. And, really, greedy homeowners are the least of our worries compared to real-estate developers and landlords.
I've seen the idea of a vacancy tax thrown around. Not sure how effective it would be, but might be worth trying.