Exactly -- if the rate of change is as high as they state -- from 10% to 30% of people in a little over a century -- it seems it would be essentially impossible for it to be the result of natural selection or genetic change.
As you say, the obvious explanation is hormonal/environmental factors.