Many people have had the experience of trying to mix consulting and startup activities and neither succeeding.
Risk aversion varies greatly for people, from my perspective it would appear you don't have enough runway to take-off and fly this startup yet. How long before you could build sufficient reserves to not need to do consulting?