Freedom of movement is a privilege, not a right? What can you possibly be talking about?
Did I miss a memo? The United States (and other common law societies) have a long history of enshrining freedom of movement as a fundamental right.
https://en.wikipedia.org/wiki/Freedom_of_movement_under_Unit...
Also, be reminded that the USA voted in favor of the UDHR, which reads in part:
* a citizen of a state in which that citizen is present has the liberty to travel, reside in, and/or work in any part of the state where one pleases within the limits of respect for the liberty and rights of others
and
* and that a citizen also has the right to leave any country, including his or her own, and to return to his or her country at any time.