(a) Not even close to the first negative HN thread about us.
(b) We definitely didn't make the thread private in response to HN.
(c) It should be public again.
(b) We definitely didn't make the thread private in response to HN.
(c) It should be public again.
At work when it came up in a meeting people went around with horror stories of broken elements while the status page wasn't updated, terrible communication and an overall attitude that nothing is wrong, even when servers go down for days at a time.
Why would anyone want to become a new customer if all they see is jumble of green, yellow and red?
Green status pages attract business.
Ordinarily, a single-host incident takes a couple minutes to resolve, and, ordinarily, when it's resolved, everything that was running on the host pops right back up. This single-host outage wasn't ordinary. Somehow, a containerd boltdb got corrupted, and it took something like 12 hours for a member of our team (themselves a containerd maintainer) to do some kind of unholy surgery on that database to bring the machine back online.
The runbook we have for handling and communicating single-host outages wasn't tuned for this kind of extended outage. It will be now. Probably we'll just paint the global status page when a single-host outage crosses some kind of time threshold.