Some of your neighbours' rights may include not having a 100 floor tower go up next to them blocking all their sun, as an example.