I've now reframed a garage, built a woodshed, and built a utility shed. I'm planning to build a cabin in the next couple of years. Working with something physically tangible is immensely rewarding.
Material costs were a little ridiculous, but since I'm only building for myself that wasn't a huge issue :-)
As an energy consultant friend explained to me: You want to control the ventilation rate, rather than relying on whatever you get accidentally (which may not be enough, especially on calm days).