It's been shown, especially recently, that HR and legal are not necessarily on the side of employees wronged by sexism in the workplace. Harassment training is an ongoing joke.
Or are you saying in other jobs men and women are less likely to work together alone, so people might think it's more inappropriate?