Do you really think so? I'd prefer to live in a society where everyone was well-educated, or at least enjoyed learning.
I think you'd find there is some spillover benefit for yourself to be had from "these low-income and minority kids" receiving high-quality education.
Unfortunately this kind of "magical" thinking is a very weak argument, and just doesn't work.
Welcome to the real world.
In short, dumb people are not going away, so there needs to be a means for them to earn a legal living.
Same exact thing happens in African countries. Every time somebody donates money/food, it goes towards procreation, not improvement of the quality of life or education.
I remember one successful African story. This group of volunteers instead of building a water well decided to involve the residents in the process. So they served as architects, while locals were doing all the hard labor. The results were really good - locals knew how to support the well. They became self-sufficient.
That, in my opinion, is the solution. It's a slow process, but I don't see many alternatives.