there was a production incident at a customer that was this exact scenario