If you take on investor money you'll have bosses, so don't expect to get rich before an exit (caveat - not strictly true, if company is doing really well, investors can be incentivized to let the founder sell off some of the equity early).
With a lifestyle business, you're your own boss and can set your own terms. There are tons of small businesses with CEO's making low seven figure salaries. These typically do not grow fast because the owners pay themselves rather than reinvest into the business. Of course the potential maximum payout of a VC-backed business is also exponentially higher than that of a lifestyle business, so pick your tradeoff.