Replace "black men from rich families" with "second-generation Italian-Americans from rich families" and you get the same result.
This is not about race, this is about belonging to a small network of Brahmin aristocracy in the US. For example, some people in New England will never invest in your startup (no matter how good it is), if your name does not look like "Landon Jefferson Bayard, III", or some such.
Even if you are white.