If an overwhelmingly large proportion of a population exhibits tendency A and a smaller group tendency B, we describe the first group as normal. It’s not a value judgement so much as it is a useful description using a word from the dictionary.
It happens to correspond to the statistical definition, and certainly that is the mathematical meaning, but in every domain outside of pure mathematics, it always implies a value judgement.
Moreover in this particular case it is not just about statistical averages, it is about social norms which were built around statistical averages. So a normality in this case it is also the rights to have social norms to be built with a respect to my needs.
Categorising a group of people as not normal has negative effects.