When one person accuses another of virtue signaling, even implicitly, there are typically only two possibilities:
1. They hold such a cynical worldview that it's reasonable and coherent to criticize someone else for attempting to publicly advocate for what they honestly believe to be right, or
2. They believe the other person is not being honest in their advocacy, and more importantly that they should call the person's integrity into question by opening that up for discussion.
When you label another individual's behavior as virtue signaling, you forcibly shift the focus of discussion on that person's behavior and identity rather than the thing they're advocating. This can have a chilling effect on people voicing their opinions with honesty and authenticity. Likewise if an idea if worth critiquing, it should merit criticism on its own without calling into question its advocates' motives.
I don't mean to pick on you in particular, I'm just calling out the use of the term.