This always seemed like one of the biggest tangible advantages of being a white dude. When someone criticizes me or shits on my idea, it never even crosses my mind that it might be because of my race or gender.
It's just a majority/minority thing.
As a caveat, it is still a pretty privileged position to be a white person, even in Japan. I think non-white foreigners have a much harder time there.