Maybe that's what people complain about where you live. In my city folks complain about having to live next to "the poors". The only thing keeping their property values up is not living next to poor people. It's beyond the pale.
That's exactly what the real issue is almost everywhere in America where there's resistance to changing zoning code. All the other stuff is just strawman arguments so these people don't have to openly admit that they don't want to live next to "those people".