As an adult, I derive similar pleasure from woodworking and other crafts, but it's challenging enough to do that as a normal kid, to say nothing of also contending with folks who can't/don't support you because they don't know how or are too afraid. So, in the end, you have either legos or the simplest snap-together models to satisfy your building urge.
Even as an adult, I have a soft spot in my heart for legos. I've considered using them as snap-together cases for custom electronics projects, but haven't delved into them enough to know what sets would work best for that application. And as much as I like them, I really don't want to buy some castle or spaceship set just to build custom cases for my DIY doorbell or assorted RPIs. :)