I said "immediate-fire", not "fire". Take time to consider all the facts before reacting; reacting quickly is usually a sign of a bad manager.
I can understand if the employee was caught stealing petty cash or fudging the time sheets; then you'd want some semblance of due process to gain absolute proof, give him a chance to resign rather than be fired, etc.
But adultery? Confessed adultery?