If you could literally sign an order right now to completely remove any control on who could come and work in your state (setting aside criminal records, diseases etc), would you do that?

I think you would probably not, because you know it would be a war zone within weeks, with the poorest and most desperate people from all around the world swarming to your small part of the world, bringing with them huge social issues.