When I was in Japan a decade ago trains were only used between cities. I doubt that's changed.
I can't fathom how you got this impression. It would be like a visitor to the US saying that in their experience, cars are only used for travel between cities.