I agree with the sentiment behind your comment, however I would also consider how the legal system seems to work. If you can’t afford a lawyer then the likelihood of “breaking the law” seems to be higher than otherwise.
Also, slavery had plenty of detractors and apologists had arguments in favor of slavery. Some of those arguments were pretty rational sounding (pretty wrong to)