The only damage this might cause you is that you'd not be accumulating any new money (or there will be less of it, when working part time) during that time. Other than that, it has many more positives than negatives: you will appear as more of a "doer", someone who can think outside of you narrow tech area of work, and you'll also have a stories to tell of how you failed or succeeded. And if that itch is strong enough, you will take take more chances like that and will in those later attempts worry less as you'll know it'll be alright. :)
Just make sure how you will fund the time you are trying to start a business, discuss with people who need to be onboard with this, and also plan the date/time you will start entering the job market should things not work out.