Lol, look at a map of Tokyo and Japan's rail network. Or Switzerland, or the Netherlands, or Hong Kong, or honestly nearly anywhere that actually builds rails.

You can do just fine on rails.

Sure, if you want to get into the rural mountains you might need to rent a car. But like, for most people rail will do you just fine.