It's true! But it's also imprecise because of that ambiguity. Take the following construction, "Now, all you guys are going to step off the dance floor."
Which could mean everyone clear out, or just the fellahs.
I don't get worried about people preferring a term that isn't "you guys", because it's probably an improvement to the language over all, even if it's some friction to change.