> But every human can easily identify black/white/Asian...
It's not the obvious cases that matter, but the borderline ones. Is that person Japanese or maybe Inuit?
> If racists believed that race is just a skin color, why would they be racists?
Yes. If we were all precisely the same skin color they'd find other ways to put people down. Your "Jewish" nose. Your "nappy" hair. Color's just the tip of the ice-berg.
Some people are perceived as being inferior because that's what some elements in society need them to be in order to advance their own social standing.