On top of that, cargo and passenger trains don't really coexist that nicely. Nobody really wants to spend bullet train money on cargo, but that's what you need if you want to have bullet train speed for passengers on the same track.
Nice thing about charging infrastructure is that another name for it is "the grid." It already exists everywhere. And in rural areas that don't have enough grid capacity for high peak loads, use batteries (which are getting much cheaper) as a buffer.