I think it makes sense to give people some rights. For example if you build a highway right in front of their house, it devalues their investment, and they could deserve compensation. Or make it a garbage dump. Are you really of the opinion the the government should be allowed to simply create a garbage dump in front of your house? What about a garbage dump in a poor black neighborhood, would you consider that OK?

It's possible there was a promise of "quiet surroundings and lovely views" when they bought the land from the government. So the government should stick to those promises.