Being able to travel to rich countries is a strong status symbol in poor countries, and corrupt rich foreigners risk not being welcome in their country at some point.
But in a sense you are right, such a scheme would lock out the foreigners who have most to gain from immigration.