Along these lines, the words "male" and "female" came to English from Latin along totally different paths, even though they seem like they'd have been created together.
masculus and femella are diminutives of mas and femina respectively.
Weirdly, English got "man" from Old German (meaning a person), but "human" from the Latin "homo", so just like female, the "hu-" in human isn't a prefix either, but derived from a totally different word.
Then again, "man" extends back to proto-Indo- European, so maybe it's all related regardless.