Here’s how it looks to be in the front car of the train when there’s a supervisor: https://imgur.com/geFIidK
Outside of the rush hour, that lid is closed and it feels like the Half-Life train at beginning of the game.
I know it’s not possible to build trains to everywhere and USA is huge but I suspect that the answer for self driving would be somewhere in between of human+ level intelligence and dedicated infrastructure.