I never worried about it. I just assumed I'd figure it out. But, that is survivor bias. I do know it was sometimes a major motivation to work harder. It was never a guilt thing, just I want to make sure they are OK.

I have 4 boys all healthy and a decent career. It's gone well for me, but there were scary parts...it increased the personal stress a lot in times like when my start-up/s failed.

It never hampered my ambition though. My wife and I are a team. We've spent 6 months plus apart as I pursued start-ups in Texas and during YC. I've never looked at my family as holding me back in any way.