This is a bit off-topic, but I've read a few stories that contradict this on the /r/financialindependence subreddit [1]. I can't find the link now, but there was a person who asked their Dad if they had any regrets. Their Dad said that they wished they hadn't retired so early, and that they had spend more time working. They enjoyed their job and they missed feeling useful and having a sense of purpose. I think it's common for people to quit their jobs too early and lose their sense of purpose, and it's even linked to a 20% higher mortality rate when you're 60+ [2].
Of course family is more important and you should spend as much time as possible with your children. But I was just surprised to learn that some people really do say "I wish I'd worked more" on their deathbed (or in their old age.)
[1] https://www.reddit.com/r/financialindependence
[2] https://www.marketwatch.com/story/retiring-early-could-kill-...