This assumes that your old person life will be shit without kids, an assumption I do not think holds true.
I don't think it's binary "sucks/not sucks", but I do think, for me, it'd clearly be sig LESS fun to be old without kids based on what I've seen of the older people in my life with different family situations. Seems shitty to me.
I'm sure there are people who have the opposite experience, but I was trying to explain why the "sacrifice" of prime years can be seen as an investment rather than a straight loss.