This argument reminds me of the "waterboarding is not torture" argument, both suffer from slothful induction fallacy.
If waterboarding is not torture then why would you apply it to detainees to confess information they otherwise wouldn't?
Equally, if diverting more energy in to finding minority candidates is not lowering the bar for them then why would you need to divert more energy to find them?