Why shouldn't I be able to move from one place to another?

If a bunch of goons will say I can't, why can't I hire another bunch of goons that say I can?