Sure, being younger allows for more time, but I'd imagine being that age has given you some maturity in handling finances, emotions, etc. I'm sure you'll have to make some sacrifices seeing that you have many commitments and responsibilities, but if it's something you truly want to do, go for it.
At the very least, you'll enjoy the ride, and when things get tough, you'll have your wife and children to find happiness in. And if you're successful, great. Either way, it'll be a journey that I'm sure you wouldn't want to regret never taking down the line.