Western cultures are still much more understanding of men being absent from their children's early lives than mothers. These sorts of cultural expectations and allowances are often taken for granted by the people who argue that "inequality of outcome != inequality of opportunity."
If women are to take a career hit for raising their kids, why shouldn't the men who fathered them take that hit as well?