And I agree with your very broad statement, our views aren't opposed to each other. Just don't confuse "the society" and "me, the individual". As an individual, I don't care about retribution, I never said that if someone steals from me then I would track them down and kill them. Instead, I only care about one thing - preventing crime against myself, with lethal force if available.
If I'm allowed to protect myself and my rights with lethal force and the society as a whole manages to lower the crime rate through any mean, be it through a better prison system, rehabilitation, or other means - that would only mean I would never have to use my right to protect myself with lethal force, and I'd be happier as a result. But I still wouldn't give up that right.