I wouldn't at all agree with that. I live in SF and can get door-to-door to a friend's house in San Diego in 3 hours. I can do similar things for LA, Vegas, Portland, and Seattle if I like.
Even when I fly cross-country to visit family (near DC), yes, the flight out is a waste of a day (unless I take a red-eye and hope I can sleep), but the flight back is just 3 hours after adjusting for the time zone change. I can take an early flight out in the morning and still put in a full day of work, or have a full day visiting and fly back after dinner.
I really don't want to spend several days just on travel, were I to take a train. I would consider that a waste of valuable time that I could be spending at my destination. I might enjoy a long multi-day train ride as a vacation (once every few years, perhaps), but not when my plan is just to get from point A to point B.
I'll usually take the train from DC to NYC, or NYC to Boston, when I'm out east visiting friends, but I recently looked at doing DC to Boston direct, and was disappointed to see that I'd burn 7 hours on a train for only $20 less than a much shorter flight. And some of the trains were more expensive than the flight!