It's not like the word "black" is just used with blacklist. We also use it in other places like black market, black hat, and black site. None of these are related to black people, but instead all relate to a shady dark/scary side of things like you mentioned.
When someone pictures a black market they are not thinking something that looks bright and colourful, they are thinking something that is dark and maybe grungy/sketchy looking.
The word policing is something I am really getting sick of.