As for "They work harder"... consider the impact of multiple generations of success, versus multiple generations of failure. I grew up what southerners call "poor white trash". I escaped, but barely, and mostly because I was very determined and very smart. When I landed at a high quality private college, I was utterly unprepared for the experience. I grew up listening to my father refer to the wealthy men he worked for as "educated mow-rawns", in that thick Kentucky accent of his. Going to college, surrounded by the children of lawyers and professors and the like, their family life was as alien to me as my dad bouncing in and out of jail was to them. I was embarrassed and ashamed.
Now, throw in the past century of crap that has kept even hardworking and talented black families down, and you can see where the problem might start.