I don't think that's a good argument. If someone says something sexually harassing to me at work and I politely say "Oh, I guess I misunderstood" to defuse the situation, it would be specious for them to later claim that my statement of misunderstanding means that no sexual harassment could have taken place.