The reason there are different passport restrictions, mostly, is wealth/income inequality. As countries become richer, their passports typically become stronger. The solution is to attack the root cause of the issue, which is that so much of the world is still so poor.