T-Mobile, Verizon and AT&T phone calls are failing across the US
theverge.com
theverge.com
That is the current suggestion: (reposted from elsewhere in this thread: https://puck.nether.net/pipermail/outages/2020-June/013124.h...
This is because of an update in the systems from the Sprint side to help merge with T Mobile. That happened from 12am-6am EST and Sprint's systems clashed with T Mobile's. I'm glad I have off today.
This event could create a reason to block the merger ex post, especially given last week's news that DISH may not buy Boost Mobile from T-Mobile, which was a key provision of the merger to reduce its anti-competitive effects.
Sprint was a shambling zombie, and any public policy measure that could be undertaken to make Sprint something other than a shambling zombie, and in particular, into a viable competitor would have rewarded Sprint for well, not being competitive.
Out of the four major carriers we used to have, we had 2.5 well capitalized competitors with large customer bases and Sprint, a shambling zombie. T-Mobile put together an offer, tendered it to Sprint, and it was accepted, and out of the many ways that Sprint could have been gobbled up by one of its larger and better competitors, T-Mobile serving as daddy to Sprint's mommy was about the best outcome you could have gotten. This puts their customer base, assuming the Sprint customers stay, at relatively equal footing with Verizon and AT&T, and more customers = increased cash flow, and increased cash flow keeps them operating in the black and hopefully with room to invest.
I don't care if we have three or four or five major wireless carriers right now so long as I can be satisfied with one of them where I live and work. T-Mobile's "Uncarrier"-like lack of billing shenanigans was one of the things that put them over the edge when I decided to bite the bullet and switch carriers. Also, with StarLink and maybe other systems like it possibly coming online and into service in the next couple of years, I'm not at all convinced it's going to matter that we only have three major "cell carriers" going into the next decade. Let T-Mobile keep all its customers, all of the spectrum they acquired. They paid for it, and I expect them to put it to use on behalf of their customers.
> This is because of an update in the systems from the Sprint side to help merge with T Mobile. That happened from 12am-6am EST and Sprint's systems clashed with T Mobile's. I'm glad I have off today.
Or
"This is because of an update in the systems from the Sprint side to help merge with T Mobile. That happened from 12am-6am EST and Sprint's systems clashed with T Mobile's. I'm glad I have off today."
Or
This is because of an update in the systems from the Sprint side to help merge with T Mobile. That happened from 12am-6am EST and Sprint's systems clashed with T Mobile's. I'm glad I have off today.
Edit: Note to use a single initial carrot > or surrounding quotes " or surrounding asterisks
> That's not going to esplain [sic] the other carriers' problems, of course, but...
Overload because people go there or NSA updating a dragnet system? ;)
A solar flare seems unlikely, since WiFi does not seem to be effected (for me at least).
Routing issue maybe?
One possibility: it’s all just T-Mobile, but people are bad at reporting. For instance: if a non technical person tries to call a t-mobile number from their Verizon phone, and experiences an “outage”, they may report this as a problem with their own phone rather than understanding that it was on the receiving end (and knowing to try to call other carriers).
This could also explain problems with Facebook messenger (if the T-Mobile outage is effecting data). It’s not a problem with messenger etc. it’s just that messenger is the service that some T-Mobile customers are trying to use and having it not work. So they report it as a problem with the black box they know as their phone.
That or we are getting hacked. And if that’s the case then buckle in and charge up your ham radios.
https://en.wikipedia.org/wiki/Signalling_System_No._7 https://blog.cloudflare.com/how-verizon-and-a-bgp-optimizer-...
e: already addressed, sorry
All Circuits are Busy Now: The 1990 AT&T Long Distance Network Collapse
http://users.csc.calpoly.edu/~jdalbey/SWE/Papers/att_collaps...
Same old military industrial complex scheme with theater pretexts.
Could be anything I guess.
They all likely share the same STIR/SHAKEN vendor, and Comcast is affected too (Comcast has working STIR/SHAKEN that interacts properly with T-Mobile and Verizon). Wonder if their shared STIR/SHAKEN vendor broke these calls?
Another bonus for avoiding the spy phone.
Edit: Lol at all this nonsense 'Anonymous DDOS', BGP fat-fingering, NSA speculation. I got karma to burn from those butthurt at me being right about the fiber cut. Look at the timestamp and region! Look at this: https://bgp.he.net/AS393494#_graph4 Who you think AS6461 is?
EDIT2: Someone else might have been partially right about merger upgrades being a factor, perhaps removed some redundancy. Before I found the Zayo cut I saw that Crown Castle was looking weird overnight (they are #1 or #2 largest cell tower company with their own acquired fiber network, Lightower): https://map.internetintel.oracle.com/?root=traffic&country=U...
"Teams continue to work as quickly as possible to fix the voice & messaging problems some are seeing. Data services are now available & some calls are completing. Alternate services like WhatsApp, Signal, iMessage, Facetime etc. are available. Thanks for your patience."
Georgia, North Carolina, Ohio, Michigan, and Pennsylvania.
(It does not appear to be a DDOS attack.)
Either way, it's being taken out of context. There are always DDoS attacks like that. The past couple of months has had constant traffic on their timeline.
I have my own theory that these sites are actually the ones astroturfing this stuff when services go down.
/s, obviously.
(Bonus: recovery keys you keep offline, in your wallet or something)
https://twitter.com/zackwhittaker/status/1272648878639255553...
I tried from a Firefox private window, my work Firefox profile (which has never went to those sites), a Chrome incognito window, and a Chrome instance being run under Selenium, so make sure I had no cookies from a previous visit to allow bypassing the text code.
So now I'm a bit confused. I hope the sites aren't doing something stupid, like associating successful text code verification with the IP address, and caching that on their end.
Maybe they've temporarily turned off requiring text codes to avoid locking people out during this outage?
This is because of an update in the systems from the Sprint side to help
merge with T Mobile. That happened from 12am-6am EST and Sprint's systems
clashed with T Mobile's. I'm glad I have off today.PS - This doesn't mean it is unrelated to the Spring/T-Mobile merger, they themselves could be the ones who screwed up routing.
https://www.digitalattackmap.com/
US and Brazil both under a massive DDOS attack right now.
Not surprising, but still useful.
EDIT: if all the other comments are correct and this is _really_ widespread then I am a little bit surprised signal is working well
911 in Central Florida is having issues.
Signal messages appear to be unaffected so far, so one more anecdote that data works, but IDK if they were delivered to my group warning them about this via cellular data or wifi.
Frontier Networks, Playstation Network, and Spectrum all went down early this morning; and I mean actually down. I had a Fingbox at my parents house tattle on Frontier Networks as soon as the connection got less spotty, and then the network dropped again.
The ISP/data failures are more interesting to me, to be honest, than the cell networks. I wonder if they're related. The cell networks all seem to share a lot of cascading failures, historically. It's intriguing that something is happening to affect the rest of the world.
The cynic in me says that someone just re-routed the internet through whatever new DPI-esque system is now in place, but I hope the reason for this mess is more innocent.
If something like that already exists, then T-Mobile should know exactly where the network is failing, and why.
If not, then maybe it, or something like it would be good to have...
I have learned from many years of software engineering that a working system is NOT proof that the system will continue to work into the future, that good logging/tracing of all system components is a necessity not a nicety, and that if you can't tell exactly when/where/why/how your system failed within 5 minutes of looking at log files -- you need to revamp your logging system so that that becomes possible.
If it takes T-Mobile more than 5 minutes to accurately diagnose the root cause of this by looking at log files, then that is proof (to me, as an Engineer) that their logging system ranges from suboptimal to non-existent, and that fixing that so that this never happens again (via fixing their logging system) -- should be their absolute first corporate priority -- after whatever is causing this is fixed.
Just one man's opinion.
I will now entertain disagreements and flames...
Ham operators are always a communication lifeline in times of crisis.
Currently, the closest thing I'm aware of for that is cwtch which is a ricochet.im rewrite
disaster.radio
serval mesh
meshtastic
a different and cool project worth mentioning, more for distibuting teaching materials as I understand:
othernet.is
I wanted to build my own for emergency services and we figured out how to do some of the mesh routing but it didn't go far... WiFi Direct unfortunately only allows you to pair to one phone at a time (while bluetooth allows endless pairing outside of BLE)
[1] http://www.broadband-hamnet.org/ [2] http://www.choisser.com/packet/ [3] https://www.scc-ares-races.org/data/packet/index.html [4] https://www.kqed.org/quest/8440/ham-radio-helping-to-build-a...
I’ve been to 70 countries and the Cuban people are hands down the most entrepreneurial of them all.
It looks like Brigify[1] does support multiple relay hops on a bluetooth mesh network to send a message.
One of the best ways to get ready to take the Technician test is to buy a cheap handheld and figure out how to listen in on the local repeater. Being able to apply what you're reading in books to real world stuff is a fantastic learning opportunity.
I enjoy listening to stuff w/ my RTL-SDR rig. I also find the emergency communication capability that radio amateurs provide a Good Thing(tm). I just can't see what, personally, it could possibly be useful for.
Chad and Karen don’t give two shits about it.
https://twitter.com/MalwareTechBlog/status/12726471098339409...
[edit] As others have pointed out, if b-number routing is failing, then their support sites would be flooded with people checking their account. So maybe the subscribers are in effect overloading the sites. That would make sense.
A website designed for most users to visit once per year when their contract expires likely won't scale to everyone visiting in an hour...
It shouldn't (or doesn't) affect Skype/Whatsapp/iMessage/Facetime/etc types of data calls does it?
Or is it T-Mobile, Verizon, AT&T subscribers and their phones, cellular phones + data connections?
Anecdotally, this is correct. I was unable to place a normal call today, but was able to Facetime the other device.
What does those services have to do with US cellular networks?
Hence why nobody is talking about them in this thread.
I see at least 3 other people mentioning it in this thread, and lots on Reddit and on Twitter in connection to these articles.
That for me was at least was at little interesting when the overall theme of this new "incident" has been "something large scale going on".
The current FCC leadership is about as inept as the Fed, except that they're not ashamed to admit they're selling out to carriers.
Is linking to graphs about the issue frowned upon here?
When submitted, it looked quite relevant to the discussion within the minutes beforehand.
Additionally, your linked graph doesn't actually contain any context or resources that could be used to verify it. It is in fact an uncredited photo from [0] which was refuted in the children of a few other comments[1,2] that were available at the time of your post
[0]: https://www.digitalattackmap.com/
[1]: https://news.ycombinator.com/item?id=23533054
[2]: https://news.ycombinator.com/item?id=23533510
️