It seems that the word “privilege” is doing all the heavy lifting here, but it sounds to me like it is a stand in for “having the ability to make anything but the default choice” (to remain in one’s location, in this case).