It's not because the accusation is against a female, it's because referring to someone solely as the spouse of someone else is a frequent tactic used to dismiss women.

That might not have been the intent, but when you accidentally use a dogwhistle, the dogs still perk up their ears.