Perhaps, but then you run into the problem of defining racism. It can be obvious, but you can also have situations like the one in yale where the english curriculum was "Colonized"[1] by the fact it had too many white male writers. Would someone who advocates for teaching the traditionally accepted cannon of english literature be racist. According to some definitions, yes. Further, some are willing to call the fundamentals of math racist[2]. Racism can be subtle as well as obvious, and to define the parameters of acceptable speech based on subjective understanding of that subtlety seems that it would likely lead to abuse.
[1]http://college.usatoday.com/2016/06/10/yale-undergraduates-a...
[2]www.dailymail.co.uk/news/article-5018223/Professor-says-math-perpetuates-white-privilege.html