I'm in medical research. Do I think antivaxxers should be able to publish in medical journals? No (unless they performed an experiment that passes peer review, etc).
Do I think they should be able to run their own websites, have nonviolent meetings or rallies without losing their jobs? Yes, I do. Even though antivaxxers are doing far more harm than neo-Nazis are.
Also, "scientific/academic consensus" and "rationality" are not synonyms.