I think there’s plenty of nuance here. Taking your position consistently, would you be comfortable referring to any christian X as “anti-gay X” or any muslim Y as “anti-women Y”? I think the label would be out of place in most cases, and needlessly divisive.