Hacker News Reader

I woke up to a few hundred messages from Icinga - thankfully my phone is on do-not-disturb overnight. Some of my servers in Newark are up and responding, some are not.

Happy Sunday! Cleaning up the automatically-created maintenance/alert tickets generated by this is going to be a fun time.

Yes, it has gotten worse as time progressed. Some k8s services started to fail, which is how I noticed something was wrong. Then the k8s control plane was up and down. Then k8s control plan completely done. Now I can't even connect to any of my non k8s servers over ssh.

Yes, my servers and all associate services are down: DNS, email, websites. It's a major outage at the whole Newark datacenter, which is their main one, no less.

Thankfully all my nodes are back up. But the DNS server as down so long that Namecheap registered it as a personal DNS server, so I am working with them to get it back up.

These are secondary effects of outage, not Linode directly, but caused by the outage itself.

Some signs of life from some of our servers now. Still no word from Linode.

For us too, nothing works at all