I think your tone detracts from your point.
> But a conference which will offend nobody in some small way is a sterile, dull thing.
I think the point to make is that this is not "some small way", as much as it may appear to be small to some - it's significant enough for you to stop attending. The group of people offended by misogyny is statistically independent from the group of people contributing to the conferences' success, so:
- there's no reason they needed to be offended
- offending them offers no real benefit
- offending them hurts the success of the conference by discouraging people from attending who otherwise would have.
- ignoring or supporting it exacerbates this problem, and so it's not in the best interest of anyone to ignore or support it, regardless of their views on women