Hacker News Reader

Lol us-east-1 already went down for a day back in 2017 when an intern accidentally took down the whole DC. We could call him “Godzilla”

Source: my startup (stupidly) hosted our entire infra in us-east-1 at the time. Was a …tough day

View on HN

us-east-1 is a great place to test your application resiliency :) it's like they threw in chaosmonkey for free!

It's funny because AWS, at least for the services I knew of when I was there, did rolling deploys to each region over several days. us-east-1 was always the final day because it was the biggest region, so you'd think it'd the safest region since everything getting deployed was well-tested. But while I was there I remember at least 2 COEs where the root cause was basically, "us-east-1 had some hacky legacy configuration that no other region has and that wasn't known/accounted for."

sounds like an easy day to me, like when power goes out, nothing to do anyway, esp. when the entire infra is there.

Reply on news.ycombinator.com