I'm sympathetic to this argument, but as an example someone from NJ could easily drive up to Secaucus Junction and hop on the NJ transit into Penn Station in about the same time as it would take to make it through tunnel + Manhattan traffic. If there are not good connections inside Manhattan or other parts of the city then that is a good argument for better public transit.