I am more of a builder than a pure entrepreneur, so YMMV.
I quit my job when my son was seven months old, took a month off, then went back to work three days a week. I'm a stay at home dad the other two.
Eight months later, this seems very, very easily to have been the best decision I've ever made.