When the outcome of a process results in a disparity (along racial, gender, etc. lines), people generally agree that the process is discriminatory, regardless of whether there was an intent to discriminate.
If the output of a hiring process results in all men being hired and no women, people would be correct to raise a concern. So if the output of a hiring process results in all hires being young and none old, should there not be similar concerns?