Ask HN: How did you handle the recent Google Cloud outage with your customers?

2 pointsboredemployee1 comment

Curious to learn how others dealt with the recent Google Cloud outage? especially in terms of managing customer communication and expectations

what did you say to your clients? how did you "put out the fire" while things were still down?

any best practices or lessons learned you'd be willing to share?

thanks!

View on HN

Luckily GCP load balancers and Pub/Sub we're generally unaffected, at least for us, which are the 2 products we depend on the most. Messages piled up in Pub/Sub while other GCP products were down but that was it. We did uncover a few spots where we had a GCP product dependency in the critical path that didn't need to be (the actual usage is optional but we don't ignore the error).

In most industries there isn't an expectation that providers are multi-cloud because these multi-region, multi-product outages within a single cloud are rare. Hopefully customers were forgiving in this case and see news headlines validating the extent of the outage.

Reply on news.ycombinator.com