I think what was more prevalent was a "unequal outcomes can be explained away by this standardized test" and then we got a chance to experiment with it and learn new data.
Still, I don't know anyone who works in higher ed admissions who wants to get rid of standardized testing for "restorative justice" reasons. Rigorous schools need to be able to ensure they don't admit students who have no hope of graduating and competitive schools need to winnow down the number of applications to a number that they can actually review.
My impression is that the objections to standardized testing typically come from groups outside universities like the NEA, FairTest, teachers unions, parents, activists, etc.