This pretty much exactly sums up why we packed up our 3 kids (3 weeks, 1.5yrs and 3yrs at the time) and moved from Seattle back home to Portland where all my family is 20 minutes away and hers is only a couple hours. We're 6 months in and, minus the income tax, it's the best decision we've made as parents.
Not having family, or people that are that close to you in your general vicinity makes a hard task incredibly more so.