I guess your 2nd man in your own company is (nearly) a close friend. So you betray him, if you leave without him. You might talk with him, what he thinks about it.
of course i already talked to him. That's one of the reasons that i cannot guarantee more than 3 days/week. With two days i could keep my own thing up and running - but obviously progress or growth is more or less impossible then.