>It is still, however, materially discriminatory

The problem with this is that this is applying a fix in the wrong place, making the effects of original injustice exist in a different form for a vastly longer period of time. In your example, the society can pay for the livehood, training and education of such ex-slaves, and help them fit back.

But blindly giving them positions that require experience and skill is going to sound nice, but ultimately your whole society is going broke. And people will once again start associating low quality and untrustworthiness with the very same people you wanted to uplift in the first place..