Consider how whoever complains about blacklist/whitelist would eventually complain about about allow/deny and say they are non-inclusive. Where would this stop?
I would say that as long as the term in unequivocal (and not meant to be offensive) in the context, then there's no need to self-censor