I used to feel this way, a little bit. Then I had a family and was glad to have the financial security to provide for my family compared to so many others.
So, consider your heirs, and work long enough to build a nest egg cushion the devote time to having a wonderful spouse, making babies and enjoying them.