You didn’t use the word incorrectly. They are just an asshole.

“Guys” as a collective noun has no sex/gender. It’s as gendered as “y’all”. Words can have different meanings.

Fuck those people.