I've been to 20 out of 30 world's mega cities. None that I've seen has a "reliable public transportation" that covers all the edge cases like what OP raised and yet have more than decent availability and punctuation. NYC's the closest and best of the bunch with 24/7 MTA subway/bus services together with LIRR/Metro North rail services. However, there are tons of pockets of places where public transit doesn't reach or VERY inconvenient to get to. This is true for tourists and visitors as well as regular commuters.
I've been a commuter riding America's third largest public transit system NJ Transit bus/rail for almost 14 years. And I have many many stories to tell you that public transit is far from perfect and it NEVER WILL BE. But for the 80% of the time when it functions well and punctuate it gets the job done. When it doesn't, I picked the lowest fair of ride for hail service, be it Uber or Lyft or anyone else who can help me get my commute's last-mile problem done. That's the consumer's perspective.