No, we don't need to talk about consent. If both parties had to consent to a conversation, the civil rights movement would have never happened.
Sure seems to me like people would have been able to say, "I don't consent to listening to these people ask for equal representation, an aggressive violation of my rights." And then the whole movement gets stopped in its tracks when it ceases to be protected speech.