They do a pretty good job of getting you very close in London and NYC. Longer distance trains get you between cities much faster than in a car. They don't solve everything but they are definitely underutilized as a solution in the US.
We could put effort into making them better but it's not as sexy.