Azure DevOps is down globally
https://status.dev.azure.com/
US Central Azure cloud is down also, must be related: https://azure.status.microsoft/en-us/status
US Central Azure cloud is down also, must be related: https://azure.status.microsoft/en-us/status
Attempting to save to my OneDrive folder on my Mac gets an error in Excel, and suggests that I save a copy to somewhere else.
Attempting to view my OneDrive files via the web interface shows no files and then eventually says something went wrong. Retrying cycles among different errors includes GeneralError, ServerTooBusy, and telling me to make sure I don't have any firewall or plugins that could be blocking access to api.onedrive.com.
For me, pipelines are queuing and not even scheduling jobs on self hosted runners.
From the "self-hosted" perspectively, interestingly what we're seeing at Depot (https://status.depot.dev/clyrvud6i57402igofm6jtb7id) is API requests to provision new runners or receive runner jobs are receiving rate limit errors, but without the regular rate limit status HTTP headers[1].
I imagine the GitHub API / Actions control plane is rather overloaded at the moment with the outage.
[1] https://docs.github.com/en/rest/using-the-rest-api/rate-limi...
Dallas, STL, KC, Chicago all count as central. More or less equidistant for east/west coast markets. Seems like natural edge node coordinates along the scale ladder.
https://bitbucket.org/blog/announcing-our-new-ci-cd-runtime-...
Come check out some of our cool new features while you're at it:
- https://bitbucket.org/blog/introducing-dynamic-pipelines-a-n...
- https://bitbucket.org/blog/custom-merge-checks-are-now-gener...
"You may not be able to sign-in to your Xbox profile, may be disconnected while signed in, or have other related problems. Features that require sign-in like most games, apps and social activity won't be available."
i can recall just before COVID hit seeing Azure AD go down -- broke all of our shit.
but you look at the dashboard and it's 100% green. "it's fine" they said, and fought us for months.
>Our systems are currently impacted by a Microsoft outage, which is also affecting other companies. During this time booking, check-in, access to your boarding pass, and some flights may be impacted. We appreciate your patience.
How can a "DNS" problem (or something similar) be this widescale?
edit:
"This change caused a complete disconnection of our server connections between our data centers and the internet. And that total loss of connection caused a second issue that made things worse. "
https://engineering.fb.com/2021/10/05/networking-traffic/out...
https://blog.cloudflare.com/october-2021-facebook-outage/
https://www.thousandeyes.com/blog/facebook-outage-analysis
Not sure if MS is going through the same issue but DNS could be a reason why
There's no way it's DNS
It was DNS
A dns error can take down the entire internet.
I honestly get the impression Azure is in decline, particularly around the .Net integrations which is their flagship ecosystem..
A lot goes into company and team culture, but I'm sure a lot here are familiar with the dynamics of outsourced development; offshore or not. Blame seeking, blame shifting, CYA, etc.. "by design"..
It's all on full display in Microsofts Azure GitHub repos.
I'm a CTO in Mexico and outsource to companies in Mexico (insource modality) and it is evident outsourcing people don't give a danm about the product . Why should they? They get paid by the hour, and if the client goes bust after they are paid, another will bite.
high availability
fault tolerant and resilient infrastructure