Google Cloud Incident – Firestore, Identity Platform and Access Management Down | Hacker News Reader

Google Cloud Incident – Firestore, Identity Platform and Access Management Down

status.cloud.google.com

5 pointsreimertz7 comments

This has been going on for hours at this point and it took Google / Firebase way to long to announce this as an incident.

As of now, authentication is down and firestore read / writes are not working.

It seems the majority of zones are affected too:

Taiwan (asia-east1)Hong Kong (asia-east2)Tokyo (asia-northeast1)Osaka (asia-northeast2)Seoul (asia-northeast3)Mumbai (asia-south1)Delhi (asia-south2)Singapore (asia-southeast1)Jakarta (asia-southeast2)Sydney (australia-southeast1)Melbourne (australia-southeast2)Multi-region: eur3Warsaw (europe-central2)London (europe-west2)Frankfurt (europe-west3)Netherlands (europe-west4)Zurich (europe-west6)Paris (europe-west9)GlobalDoha (me-central1)Tel Aviv (me-west1)Multi-region: nam5Montréal (northamerica-northeast1)Toronto (northamerica-northeast2)São Paulo (southamerica-east1)South Carolina (us-east1)Northern Virginia (us-east4)Oregon (us-west1)Los Angeles (us-west2)Salt Lake City (us-west3)Las Vegas (us-west4)

"it's been going on for hours" - uh, if you have customers in Norway, Sweden, or Finland, it's been going on for days. I have spent most of my conscious time over the last 24 hours trying to convince my Google support contact that this is real. Well, it took two days to get stateside but they believe me now

That sounds awful. Can you elaborate a bit. What service(s) did you have issues with? where were your databases located? Multi-region?

Same here in Australia. Firestore has been intermittently buggy for days - randomly timing out, throwing errors, etc.

But it wasn't until a few hours ago that some of our customers were completely locked out of the site due to permissions errors.

Literally spent the last hour trying to figure out why my app was failing. Only thing I was seeing from my side is "permission denied".

why can't Google be bothered to put outages in Firebase console... Or allow us to see better logs?

Pretty sure this affected Hacker News login as well

Finally! Just one more hour..

  The mitigation is expected to complete by Wednesday, 2023-11-15 19:30 US/Pacific. We will provide more information by Wednesday, 2023-11-15 19:40 US/Pacific.

It’s unfortunate that because of this issue I can’t track when my baby eats and shits since the app logged me out for some reason and there’s evidently no offline mode

Reply on news.ycombinator.com