Same here. I think my favorite unsupervised childhood memory was the time when (I was about ~10 years old) the day after a big rainstorm, that turned a nearby creek into more or less a river, we took a couple of inflatable rafts and went for a little boat ride. We ended up miles and miles away from any of our parents' houses and once it started to get dark, we hopped out of the stream, went and knocked on some random person's door and asked to use the phone.
Our parents weren't thrilled at having to pick us up, but we had a great time.