The issue with this approach is that long-time locals will see the market price of their homes rise with the newcomers'. So if you base the tax on that market value, the locals have it very rough.
You just need to align incentives and make it so people who benefits the most pay the most taxes. Preferably proportionally to how much they benefit from the whole arrangement.