It depends. There is no strict requirement onto starting at the early age. Yes, there is a correlation, but no strict requirement.
I knew someone, who had really started coding only at around 22, after she had finished a computer science / engineering degree. She was not a tinkerer/nerd, just a regular bright girl, her dad was not an engineer [was an architect]. Only she was really really bright, and she really put in some effort, and just in a few years she became really really good. I've since met many good hackers [having started at 4 and now some 30 years down the line :-/], and I still consider her to be one of the best overall, starting from the love to build things, to clean code and clear thinking, to teamwork...