Yes, I would have abstained. Mind you, my grand parents are from the very most "underprivileged" part of France, the kind of place were half of men are dead before 50. Still, what people do there was working hard, not theft, drug and robbing the few rich around.
The problem is in large part cultural. You can see it easily with East-Asian immigrants that arrived dirt poor, yet saved and send their kids in college. After one generation they are not poor anymore. In Europe, the division are the same (White+Asian vs Black+Arab) despite difference in history (no descendants of slave). Also, education and healthcare are free and there is the welfare money. So why the results are similar? Because some value education and other don’t.