If you eliminate private prisons entirely and leave everything else alone, a pitifully small proportion of the people wronged by the criminal justice system would even notice, let alone receiving fair recompense. It's not so much that they "should not" be fought against, it's that it barely matters. It is simply poor allocation of attention.
Forest, trees, etc.