I'm 44 and starting a few small startups; individual SaaS products that are small enough to be able to complete to market in a reasonable amount of time in between responsibilities. Unfortunately that's been a year in the making now. Fortunately it continues to progress. There's an old saying; "progress is better than perfection" and I feel it applies to this phase of life trying to accomplish this sort of thing.
The biggest thing for me was mitigating risk. I have a full time job that I'm keeping while doing this, and I've leveraged things like using Wyoming for an LLC to reduce fees and cost of having the business entity, and startup credits on cloud providers to kick off the business at minimal cost. If I fail, I probably won't be out much other than the time I've invested and about $1000. Worth the risk of another income stream, and a better bet than the casino.
Also want to add that my top and first priorities are my children and financial responsibilities. The startup comes second.