'more difficult if you have children' seems like a huge understatement. Especially if they're school-aged.
It is absolutely no coincidence that the vast majority of people who do these sorts of things have no children. This is not to say that I don't think it's commendable to get out in the world like this, because if you can it's a great thing. However, I get annoyed with folks who seem to think there couldn't be any possible reason that someone wouldn't do the same.