It also penalizes non-fathers because employers assume the possibility of you having children, and that has an effect on your pay, even if you never have children.
As a non-father, you have no way to say "I don't want paternity leave" and negotiate a better salary instead.