If those are the greatest risks, it sounds like it's easy to buy low and sell high. I would have thought that that's the biggest challenge.
Empirically, you could have bought a share of the SPX at any point in time, and sold it with profit later. The real problem is what happened in the time between, and whether you were able to hold on.