AWS had an identical failure with their ATS(automatic transfer switch) system which took out an availability zone. After some forensics and a code review of the plc software, realized it was an omission in that system.

They now make their own if I remember correctly.

https://image.slidesharecdn.com/cpn208failuresatscale-121129...