Yeah, there's a good book on this very issue called "Weapons of Math Destruction."[1] The author did an interview on a podcast and discusses how algorithms used by these judges reflect our racial biases.[2] One example that I remember is that the algorithm takes into consideration one's zip code, which correlates strongly with race in the US.

[1]: https://weaponsofmathdestructionbook.com/ [2]: http://www.econtalk.org/archives/2016/10/cathy_oneil_on_1.ht...