So that either those people will not get at all help, or a reduced amount of countries (and maybe even poor countries) will be forced to bear the burden of helping them.
You get richer by getting trickle down economics of wealthy individuals[1], and the rest get poorer.
[1] The more plausible outcome is that, as one sibling comment mentions, you will not get that much from those wealthy individuals. They will come with their millions, squander your resources, workforce and capital, and move to the next bidder in a couple of years.