To the contrary, Stanford, for instance, has ~22% of its student body "White or Caucasian", when it used to be 40% in 2016. This swing didn't occur simply because white students stopped applying.
https://stanfordreview.org/stanfords-racial-engineering/
Stanford might be an outlier, but I don't see white applicants being negatively affected by this decision. Quite the opposite.