So if we don't widen roads because people might have to move then we get more accidents. Or the city can't grow. Or people sit in traffic for extra hours a day.
People's needs need to be taken into account, yes, that is what it is all about in the end.
But a few people's inconvenience or greed outweighing the general progress is not a long term formula for successful society.