I once took Amtrak from Portland to Seattle and it took me over an hour to make it across the Columbia River. Apparently it had something to do with a delay and freight trains having priority.
Even with bad traffic it takes longer for me to take the Metrolink to LA than if I drive. Up until recent gas price increases it was more expensive too. I haven't experienced rail service on the east coast, but at least in my experience on the west coast it is horribly broken. I say this as someone who believes in it and wants it to be successful. I have given it so many chances and it has failed me every time.