I think he means that, the reason he took it to the extreme that his family life suffered was due to his unfortunate circumstances.

This is a really great documentary. Just saw it because of the post and the entire time I can't help but think of how this applies to any life and the to the pursuit of happiness.