The disagreement is essentially about the best way to achieve equality, which though a nebulous term is accepted as a goal without debate, even though the definition of the term can be widely different, as in this case. The conversatives argue that we can only achieve equality by being colorblind. The progressives argue that we can only achieve equality by consciously addressing inequality.
I see some merit on both sides. I tend to lean toward the conservative view, but I recognize moments in our history where active intervention was both noble and necessary (desegregating schools, for example). The question is whether those actions were special cases or are examples for us to follow going forward.