The problem with high-speed rail is that for decades it will only benefit large urban population centers. As such, people in rural communities or more sparsely populated cities have little to no incentive to go along with funding it. If a person has to drive for an hour in the wrong direction just to get on the train, then the train has no real benefit to them.