This remark always comes from people who do not have children. I have never seen a parent express regret over building a family.
Most of the parents I'm close to are in the "wow, this actually kind of sucks" category.
Against what I hear about parenting, I'm mostly left feeling unsatisfied and unfulfilled, but what am I going to do? Maybe it'll come later.
That doesn't mean it's impossible to be happy without a million dollars.