advantage leads to more enjoyment, which leads to more practice...etc
I actually agree with you here. This is why I think things like sexist/marginalizing presentations at conferences are a big deal: a hostile environment seems to me a lot more likely to achieve this than possible differences at the bare fringe of the aptitude spectrum.