There's a word for this: Type II Fun. Type I Fun is when you're having fun and you know you're having fun while you're doing it. Type II Fun is when you're absolutely fucking miserable the whole time, but afterwards you and any of your friends that were with you say it was the best time ever.
Lots of outdoor activities that are supposed to be Type I Fun end up being Type II Fun. Lots of activities that aren't supposed to be fun at all end up being Type II Fun. (basic training is a common example) I've heard Dwarf Fortress is Type II Fun, but I could never get into it.
This whole process of building the cabin sounds like a class example of Type II Fun to me.