You can't tell the poor to "move away" from their place of residence. They mostly can't Even if their neighbor is a murderer.
The nimby situation is forcing the less fortunate people to commute beyond what is humane. A 2 hour commute is not healthy. And they CAN'T move away, mostly.