> The residents "dealing with the costs" also need things delivered
This generally works in favor of people within the congestion zone, because time is money and delivery drivers can do far more deliveries per hour.
> or a ride to the places mass transit doesn't support
Residents of Manhattan below 59th can easily take one of the above-mentioned transit options to get to Jersey City, Queens, Brooklyn, or Harlem, and get in an Uber or Zipcar from there. But if someone needs to do this most days, perhaps they shouldn't be living in Manhattan.