one, two and zero are all numbers.
But what is more important is that you illustrate the hypocritical argument, that if a "number of people" do object the participation of another speaker it is ok to uninvite him. Nodovember should be more concrete or shut up.