AT&T outage caused by software update, company says

Having until recently worked for AT&T I suspected this was the case based on the nature of the problems and the timing of when it started - however I am a bit surprised that the repair took as long as it did. I'm wondering if this broke something in their Openstack environment that hosts most of their LTE SDN?

[dupe]

Some more earlier: https://news.ycombinator.com/item?id=39475687

I was a short-term contractor (3 weeks) for an at&t internal web app. It's amazing anything works at all inside that company.