We already allow freedom of movement from countries within the EU, whose population sizes are an order of magnitude more than ours. Yet the amount of paperwork it takes for a US citizen to work here is fairly high. They also don't get any unemployment benefits as long as they are on a work permit because of NAV's rules.
Why should the US offer us more than what we offer them?