People with racist or otherwise regressive views know that these views will (rightly) get them criticised by the majority, and so they won't couch them in those terms precisely, but it's often very clear when you take context into account. I can't speak for this exact case, because we don't know what his exact words were, but it's telling that even your defence of him describes him criticising protesters at a time when protesters are being shot and having chemical weapons used on them by the police, a state militia who can kill pretty much anyone without threat of consequence. If your stance in this case is to support that militia, their murders and their use of chemical weapons, then I think that it's not remotely unfair to say that you not only do not support the black lives matter movement, but that you support the continuation of black people in the states being murdered without recompense.

When you have such a significant power over someone's higher education and therefore their life earnings, I don't think it's unfair to scrutinise these people's views further than had they little structural power.