High expectations or low expectations, people often rise to the level expected of them.
Not to mention, whether you got in on the regular track or the alternate track affects people's attitudes about your abilities. People need information about others, and the circumstances of how they joined the organization (whether they are in the group that got assistance or not) is a source of information. Sure, some people have been trained to ignore that for the sake of fairness, but not 100% of everyone.
Phrasing such as "a minority" might be seen as unfavourable.
"A minimum is sometimes required" -- if this is about positive discrimination / affirmative action, this is a potentially controversial and complex topic, as other posts in this thread reveal.
However, I do agree with your point that discrimination in employment can indeed be very hard to prove for individual cases, even though broader statistics may illustrate that it occurs.