You're looking for a lifestyle business.
They are great. You will get time in the garden, that's awesome.
Vacation someplace with no phones? Out of the question. Weekend in a 3rd world country with character and food and sketchy internet. Not gonna happen.
You want to optimize for free time in the garden by all means you can do it, but you loose out in other places, you pick up other work (taxes, systems etc).
Edit: Down vote away, I live this life now, my tomatoes are delicious and I make yogurt too!