To raise kids (in a responsible good manner), you need a long-lasting stable relationship with parents that are trustworthy and on the same wavelength.
OP is currently in a relationship with his wife whom he loves dearly. But regarding kids they don't seem to be on the same wavelength (on one particular topic, they probably agree on many other things), because he regrets decisions they made in the past.
Why will his situation improve by giving up the relationship and becoming less trustworthy? 5 years down the roads, in a new relationship, he or his new wife will decide their wavelengths changed, and it's time to look for someone else. And then 2 small kids will have to cope with the fall-out.
Divorcing someone you love, with the intents of starting a stable relationship with someone else is self-deceit. Kids deserve better than that.