I'm British, it's customary here to use 'girl' instead of 'woman'. It can be offensive to say 'woman' to a woman under the age of ~50.
different cultures have different standards for appropriateness and harrasement: you are trying to not be offensive and so used the world "girl", and someone else is offended because you didn't use the word "woman."
To be clear, I'm not talking about the harassment case here, I'm talking about the "call them women" comment.