Back in the days of slaves, someone would have argued how slavery isn't that bad because there were more worse things in their past and how slavery was an improvement in the lives of those slaves compared to what they would have had in their home country. Your argument reeks of the same moral flaw.