There's an irony in that we want criminals to reform and rejoin society, yet we arrest them for doing so on their own initiative. He could have continued to commit crime, leaving a trail of bodies, and he probably wouldn't have been caught yet. He chose to live a quiet life somewhere out of the way and ended up getting caught for trying to be a normal person.
If he were going to continue living a quiet life there til he died, I have to wonder what we've actually gained here. Yes, he did awful things. I'm not denying that, but nothing we do to him is going to change that. I'm not really convinced that cracking down is going to prevent future crime; it doesn't seem to have stopped the mafia thus far. He's not going to talk, the investigators have called out that they can't make inroads because of their brutal code of silence.
The only thing we get out of this is a sadistic pleasure from punishing a man who seems to have reformed. It's justice porn. Why would anyone on the run from a life sentence bother to try to reform then? You may as well stay in the Mafia; there's nothing for you on the outside.