Why do your friends and family think that? Do you agree with them?

Given your freelance background, I would imagine you might know more than most first time entrepreneurs? I haven't met any business owners who surrender having a life for their biz (though I haven't met any multimillionaire business owners, either). Perhaps finding patterns in your freelancing and building those solutions into products while continuing the per-project work would be a good in-between to help you decide?