I'd see someone appealing a sentence for selling some OxyContin and think, "geez, what a waste of money to put this guy in prison." But he's got a rap sheet a mile long - theft, robbery, assault, etc.
The treatment of the criminally-accused in this country is deplorable. But it's also the product of a society that got fed up with skyrocketing crime a few decades ago and responded in a harsh and heartless manner. Crime is a lot lower today than it was in the 1990s, but even in the safest American cities murder rates are 5 times higher than big cities in Europe that aren't even considered that safe (like Berlin). And crime is heavily concentrated in poor places like the Bronx.
And the usual canard - for profit prisons - isn't even applicable here. Private prisons are illegal in New York. This isn't lobbying at work, this is purely a product of the democratic will reacting to devilish social issues. That's what makes it so hard to fix.
[1] I was also living in downtown Baltimore during the post-Freddie Gray unrest. I was disappointed to see the acquittals. At the same time, if I were in those cops' shoes, I'm not sure if have the moral strength to be any different. Society needs a certain amount of order to function. In much of Baltimore, that order doesn't exist. Gangs are in charge and the law-abiding people of those neighborhoods are the biggest victims of that.