Excellent writeup indeed. At work we’ve heavily invested in the circuit-breaker pattern [0] following a cascading failure from last year and since then we’ve managed to avoid many large-scale outages. Very interesting to see other solutions to this problem.
[0]: https://martinfowler.com/bliki/CircuitBreaker.html