I've been the white guy in that situation, and it can be not great, but it was specifically with a 90% Chinese team. I can tell you who never quite fit in and who got laid off first...

I wouldn't join a team like that again because of how much harder it made things. Maybe this is an argument for why diverse teams are good?