Prison is where criminals go. Jail is where people not convicted of a crime go.

Drug Offenses are nearly half the prison population [1]. So the prison population can decrease by significant amounts without releasing any violent criminals.

[1]: https://www.bop.gov/about/statistics/statistics_inmate_offen...