Because it gets used to paint a picture where white people are only successful because they were somehow privileged, which isn't always true.
It's really quite racist actually, you are using skin color as the defining characteristic when socioeconomic status is far more relevant.