We know that hormonal derivatives like steroids can influence appearance, and also that ambient secretions offer signaling at a distance among humans, in circumstances not limited to the synchronization of menstrual cycles, at a minimum.
Take these factors together, and exclusive close proximity to gender concentrations based on preference likely results in mild changes in appearance that automated analysis can determine as a non-zero signal, and hazard an informed guess with. People are not wrong in claiming that this is a form of stereotyping, and that sometimes the stereotype will be incorrect.
People may not like it, but just because you can't see it, doesn't mean it's not there.