What do prefer?

Giving up on having kids and staying with your partner, trying to cope with regret. I bet the regret alreay takes a toll on the relationship and the probability is high that the relationship ends in a divorce either way. (Divorce statistics in your region?)

Divorce and find a younger and religious woman ready to have many kids. You might lose some friends and people might turn away considering your behavior selfish. But you would gain a family and that would be your world.

It is not too late to correct a mistake.