No, inclusivity is not about banning speech, it is about making sure that people can feel comfortable in an environment.
Sometimes that means enforcing certain standards of speech and behavior. Which you already agree with, if you are at all functional in society.
The question in this case is not whether inclusivity is a good thing, it's whether Crockford's speech/actions were "bad enough" in the context of a conference. I don't know (and don't care to know) about that, but it's vitally important not to throw the inclusivity baby out with the bathwater.