You'd rather work for some unassertive, passive-aggressive guy who lets employees betray his trust and just turns the other cheek?
I can understand if the employee was caught stealing petty cash or fudging the time sheets; then you'd want some semblance of due process to gain absolute proof, give him a chance to resign rather than be fired, etc.
But adultery? Confessed adultery?