It's because the city can grow only so much. You are not buying the right to freeze the neighborhood in time. You are not buying the right to forbid everyone else from building up and altering the face of the neighborhood.
I am sorry but the price you paid for your house / apt was too little to justify this behavior.