My wife and I are almost to the point where all of our veggies are from our backyard. Fruit is a WIP as we have a few trees and bushes, but they take a few years to start producing.
We both work full time and spend the weekends out in the yard harvesting/planning. With irrigation to water and a little planning, it becomes a passive hobby.
I will say, I think you'll still need to buy stuff, like beans, broths, spices, etc. You can't have it all in your backyard, but you can have the primaries.