It's not racist to assume that you can more safely trust other people that look like you, because most people are racist and are therefore less likely to betray the trust of someone who looks like them. There are sociology / anthropology / psychology experiments and studies and stuff if you look.