I don't know about you, but when trying to figure out if someone is female by sight alone, long hair is a big clue, after clothing and before facial characteristics. Visual analysis can only reveal surface characteristics that are subject to manipulation (up to and including hormone therapy and plastic surgery), not "intrinsic", whatever that means.