I couldn't agree more, I can't imagine how much more I could have picked up at that young age if I'd just had, say, a tty, instead of endlessly playing with window themes, notification sounds and so on.
Another thing that's important though, you need to be able to make the computer do fun things pretty easily, otherwise you'll (as a kid) loose interest.