Recent history has vastly improved the majority of people's lives. Prior to globalization, it's not like China had good workers rights or Ukraine built a lot of microprocessors, so you are setting up a false view of the world without globalization.
Of course this is partially a domestic policy thing, but how we view foreign labor now is not working.
The "stop exploiting poverty" sophistic frankly doesn't map to reality. If the US pulled out of trade in Vietnam they would get worse off instead of better. The issue isn't the result of an action to be stopped which turns the entire notion into dross covered up with guilt tripping.
It is the same "leave the cookies on the table to gather dust while trying to eat far richer imaginary cakes" mental pattern as IP zealots who snub overseas direct sales with things like region locks because they think they could get more selling distribution rights months.