so you believe that physical difference between sexes in size of the brain, is not due to sex? what would you say this is caused by?

I would like to point out that saying this changes are due to evolution not sex is unvalid because then nothing will be due to sex, not saying that you think that but just getting it out of the way.