Looking holistically the person leaving the US (or lets say 100 people to make it easier to see the point) means 1 to 30 less startups and so maybe an entire company or more not being started. That is less revenue for US.
What most people from the "they steal our jobs" mentality (not saying that is you, but this a seperate point) don't get is productive people create jobs by being a customer of many businesses.