I read an article a while back about how Brightline chooses it's routes. I can't find the article at the moment, but I remember the CEO basically saying they made it work by being ruthless with strict parameters.
Specifically, Brightline won't build rail unless the following are all true:
1. The trip must be between 200 and 300 miles. Their research indicates this is the sweet spot between being more than a convenient car ride, but less then a convenient plane ride. I'll note that LA -> LV is ~180 miles, whereas LA -> SF is ~340 miles.
2. Leverage as much existing right-of-way as possible (The LA -> LV route follows the highway)
3. The market for consistent commuter travel between the destinations must pencil (Miami to Orlando / Disneyland, Los Angeles to Las Vegas)
I honestly think the US is so large and geographically diverse, you just need to be really picky when choosing high speed rail projects.
Also fun fact: I used to think that the biggest cost difference from flying vs rail travel was maintaining the rails. The biggest cost difference is actually the staff. Since flights are so much shorter and require less staff per seat, the per-hourly cost adds up.