Fun litmus test, if the person challenging this assertion happens to be a straight male: "how many guys have you slept with?"
So "the guys" or "how many guys" always refers to men, but "you guys" carries no implication of gender at all. I often hear people address groups consisting entirely of women as "guys", and nobody bats an eye.