There isn't enough room in the Ivy league schools for all the competent people in this country to have an Ivy degree, even if you kicked out all the 'legacy' admits.
If anyone's treating attending a non-Ivy school as a negative signal for competence, I can only treat that as a negative signal for their competence.