I propose the following solutions:
1. A building's minimum height is dictated by the demand in the area; your existing building can stay, but if you want to bulldoze and rebuild as a developer, you must build up if the local real estate demand dictates so (I don't have enough experience to determine how you'd calculate demand, perhaps trailing rents for the last 24 months?).
2. Renters rights remain in place, with the government providing subsidies and relocation assistance when necessary (funded by a special property tax on non-owner occupied units).
An equilibrium can be reached, but the idea of "property rights" will need to change a bit, with the understanding that a healthy neighborhood is more important to society than you having full control of your property (which is already the case, considering zoning laws and what not).