The practical ability to move somewhere--e.g. to find a home, place an offer, have it accepted, and then peacefully coexist in the neighborhood.

These are all largely up to the discretion of individuals in the community.

They could legally move there, but they would be shunned from the community, and indeed it may be hard for them to find someone willing to even sell them a house.