> It seems like such an increase would benefit everyone except the speculators.

Correct, a simple power law tax formula on unimproved/vacant land that forever increases the cost to hold onto land near and in the middle of population centers would do wonders.