The fact that you're stomping all over a person's right to own property and use it as they wish?
Oh sure, the city will prosper as a result, but when you start making rules solely for the sake of the majority, throwing basic principles into the garbage bin, you set a precedent.
A precedent where anything that's for the greater good passes muster, regardless of anything else.
Which seems fine at first. The majority, is the majority of people right? Why not act solely in their interest?
But the truth is that we're all part of some minority or other. In some way, everyone's interests contradict the majority in some way.
If my grandma lives in the suburbs and it takes 4 hours to see her using public transportation and 30 minutes using a car ... well, you just fucked me over, didn't you? And that's just a mild example.