Let your employer fund your ideas through your paycheck--they don't own your nights and weekends.
I find the hardest challenge when I start a part-time project is staying motivated at the day job. If you're happy there and can achieve this balance then you have the benefit of both worlds.