Because it "erases Blackness and centers whiteness as a default", that's the standard answer.

Yellow codes for the default, which is whiteness. Or said another way, white skin is the only unracialized skin color. Thus the supposedly neutral yellow stands for it.