I'd actually argue the opposite. If you sacrifice retirement savings in your 20s, it's going to hurt a lot more than sacrificing some contributions in your 40s.