Because they're human? Because wrongful convictions happen? Also, the deterrent effect of prison is more dependent on certainty of punishment, rather than severity of punishment.[1]
[1] -pdf warning http://www.sentencingproject.org/doc/Deterrence%20Briefing%2...