I decided to take a break from society last year. I'm fortunate enough where I am that it's eminently reasonable to do.
I found some Mennonites that build small 14 * 28 foot cabins with two sleeping lofts. It costs about 8k, and that includes delivery to your land. They come with the exterior/roof finished, but the interior is up to you.
Your personal asceticism modulates the cost. My shower is actuated by a ball valve. I set the temperature at the inline gas water heater to perfection, so I don't need hot and cold!
I was surprised to learn how cheap the insulation, carpet, sheetrock, mud and paint were.
Rural land here is about 2k per acre. Many plots already have wells dug, but if not It'll cost about 4-6k to get one drilled, and 500-1000$ for a well pump.
Septic tanks are a few grand. A trenching shovel is cheaper, but that option depends on the topology of your land and your heart.
I get my electricity from solar. If you do that, you need some panels, an inverter, charge controller and batteries. My system is pretty modest. 10 deep cycle batteries. I've lost track of how many panels we've got. Most of them we soldered the cells together so it kind of all blurs together. The whole of it probably cost about 1700$. It's enough to run our super efficient 12 volt fridge, the pump and a few laptops.. except when we go a week without sun during the winter.
Next consulting gig I get, I'll probably get a wind generator as well.
When it's oppressively cloudy, I use a small gasoline generator to power all the stuff. It also will kick on a battery charger that'll top the batteries off.
This winter I used a propane heater. I've come to realize liquid propane is somewhat money inefficient compared to a wood stove. I'll have the wood stove installed by next winter. I'll probably keep using the propane oven.
Leading up to me dropping out of society, I came to resent paying rent.. I resented the thought of office power games having survival consequences for my life. I didn't have to off-grid like I have.. There are power lines. It's just such a great feeling to cut out monthly subscription costs from my life. The serenity it brings is maximum. Mother gaia gives me my water and sol my electrons.
I still do consulting work as it comes to me. Blissfully, I no longer feel desperation and anxiety between contracts.