Yeah for sure. Like it's not racist that I like the white part of an Oreo cookie more than the black part. It just so happens that the cookie portions is called black and the filling colour is called white but other than that the colour is irrelevant.

I also have never heard of white markets, but I have heard and often use the word "grey market" to indicate an in between of legal and the illegal markets. This helps point to the fact that the word is not used in the racial sense, but instead the colour itself reflects a certain vibe. Grey is a bit brighter than black but not quite as bright as white. Thus the colour can indicate an in-between.

But like you mentioned "black market" and "grey market" probably won't be targeted by cancel culture since there is not an opposing white element.