That's the "punitive" side of things. Certainly, it seems "fair" to ensure the punishment is equal to the crime, but fair isn't the same as just. Why don't you go Code of Hammurabi on someone, and inflict the same kind of injury? The logic still holds. Of course, it now requires people willing to commit torture and rape and the like, to equal the crime, but that's the logical conclusion of trying to be "fair".
But even without taking it to its conclusion, I'd contend "fairness" as you define it there isn't necessarily the best outcome for society; an ex-hacker is probably an excellent choice when hiring for electronic security, an ex-robber an excellent choice for hiring for physical security, etc. Even a murderer can go on to great things that benefit society. I mean, hell, Miguel De Cervantes, author of Don Quixote, the first modern novel, wrote his first published work while in prison. The Birdman of Alcatraz (Robert Stroud), a murderer, published major works in ornithology, and found a cure for a bird disease. Rehabilitated criminals can still benefit all of us, as well as redeem themselves in their own eyes by doing good for themselves and their loved ones.
But all that aside, you're saying you believe the additional punishment should be societal scorn carried out by vigilantes (i.e., average citizens deciding the person shouldn't hold a job even though they've paid the price the courts decided on)? That hardly seems just or 'fair'.