This is true of all public transit systems, even the best ones. Unless you live directly at the source station and have a direct shot to your destination station, you're going to waste a lot of time changing buses/trains and waiting and coordinating.
And not everybody can live near every transit hub, not even near _a_ transit hub, by definition.
Cars are point-to-point. The very best public transit can do is match it in terms of pure speed.
Public transport has a much higher bandwidth at the expense of individual travel time. It's a trade-off. Naturally there's a limit to how many cars can dive at any given time in any given city, but I'd definitely expect the average public transit time to be 2-5x the equivalent individual transportation (bicycle if possible/car) transit time.