I will give you that Linux is needlessly complex due to undesirable issues, but that's the price of admission for a highly hackable system, since there are no serious alternatives. As for kids, I wouldn't underestimate them. If what you want to give someone is a rich and deep experience with computers, it's about all you have right now.
On the other hand, and I'm sure this part of my comment will go over swimmingly here, but I imagine... if you start kids out with iPads, what they learn is not that doing interesting things with their computers is challenging, but that it costs a monthly fee.