Everyone in science knows that all knowledge is provisional, and that goes 100-fold for things which haven't been replicated. Science is an algorithm for ratcheting understanding despite the fact that humans are fallible and some humans are outright frauds.
Or in other words, it's hard to tell from the outside who really believes what you're stating and who believes it until it's inconvenient, or until it clashes with their personal ideology.
People acting in bad faith will appeal to whatever authority they think will achieve their goals. It says nothing of the legitimacy of Science, and if you let the actions of bad actors take actual Science off the table, you've only empowered bad actors to make things far worse for yourself.