And yes, maintaining the peg and free movement means that the higher level government does decide what to give them. That's what giving up sovereignty at a lower level implies.
Even at local level, they need manpower, not land. So you end up relying on fungibility.