Yeah, pitch is only one of the components of speech pattern differences between genders. Others include resonance, intonation, rhythm and more.
Ask a trans person and they will tell you that changing your perceived speech gender is much more than just the pitch.