You walk out the door. Or you wait until the server is away from your table before walking out the door if you don't want to risk confrontation.