Isn't skin color based privilege the same though? If someone darkens their skin so everyone perceives them as black instead of white, then that person lost their privileges of that point forth.

White privilege is very much a treatment by society. Racism and sexism are both enacted upon by people based on social norms.