Scientists: Don’t Feed the Doubt Machine
nature.com
nature.com
> [1.] researchers must learn to identify authors of research, and their relationships with industry and with non-profit groups that have specialized agendas.
So research is not allowed to be respected by scientists if done with underlying business interests?
> [2.] scientists should consider what kinds of argument the data and conclusions serve.
So you should intentionally bias your results if they don't fit the narrative you wanted?
> [3.] scientists can consistently highlight correct information and avoid serving as inadvertent amplifiers of flawed information
This gets to the core of the problem. It assumes scientists know the truth and the 'correct' studies.
In my experience, my friends with unwise and problematic takes on Covid are almost 100% in the camp that scientists are trying to do the very things this article says they should do!
What we need is scientists who have backbone, who have an unwaivering unaltering desire to get to the truth at all costs. Anything less is both not scientific and not someone you should trust. You won't get the clear answers you want from this individual though.
> First, researchers must learn to identify authors of research, and their relationships with industry and with non-profit groups that have specialized agendas. How the tobacco industry paid scientists and physicians to serve as advisers and consultants to undermine the body of evidence pointing to the harms of tobacco is extensively documented. More recent examples abound. For instance, the non-profit International Life Sciences Institute, based in Washington DC and funded by leading companies in the food and chemical industries, promotes doubt about science that links ultraprocessed foods with health concerns, and provides experts to promote personal responsibility rather than regulations on junk food in policies to combat obesity.
Edit:
> What we need is scientists who have backbone, who have an unwaivering unaltering desire to get to the truth at all costs.
This is one part of what this article is demanding. It's arguing against efforts of entrenched interests - often businesses - to obscure the truth or make it harder for the general public to tell truth from untruth.
The second part is about taking action. Informing is one part, but at some point courses of action have to be decided - and for many problems, it's not enough to delegate this to individuals, the decision has to be taken on a collective level. Because we will never have 100% knowledge, a certain amount of uncertainty has to be tolerated when deciding on a course.
What this article also argues against is tactics that specifically target this unavoidable amount of uncertainty with the interest of delaying action.
That is the whole point of having a transparent debate and looking at falsifiable evidence/tests.
And doing that is not the scientist's job. So scientists should not be filtering what they say because they want to encourage or discourage some course of action. They should just be telling the truth as best they know it.
> for many problems, it's not enough to delegate this to individuals, the decision has to be taken on a collective level.
First, I think the problems for which a collective decision has to be made are much rarer than many people think. Governments have gotten their fingers into all kinds of pies that they don't actually need to be in, but where government intervention serves a special interest.
Second, there isn't just one collective level. There are many of them. As a general rule, you want people who are going to bear the costs and reap the benefits in a particular area to be involved in collective decisions about that area, but you don't want people involved who aren't. That generally means pushing collective decisions down to the lowest possible collective level. But again, our political system very often doesn't do that.
Third, when it comes to collective policy decisions, scientists have no special expertise; they are just citizens like everyone else. Scientists who believe some kind of action is required because of something they found in their scientific research still are only seeing that one narrow viewpoint of their research; that doesn't give them any special ability to see the big picture or to take other interests or factors into account.
> What this article also argues against is tactics that specifically target this unavoidable amount of uncertainty with the interest of delaying action.
Uncertainty can be used either way: it can be used to try to delay action, or to try to motivate it (we don't know whether X will be a problem, but if it is, it will be huge, so we can't take a chance on not doing something about it). Both can be issues.
But this is exactly what the article is arguing for. Often enough industry groups like the tobacco or oil industry were manipulating policy such that they were reaping the benefits while everyone else was bearing the costs.
Those industry groups are already producing biased research. The article argues that more scientists should be ready to expose this bias.
This rule also isn't completely general. Those who bear the costs, those who reap the benefits and those who would be affected by actions might be three different groups. It sometimes can be desirable to make a rule that is applied very broadly to avoid inequities and arbitrage effects. Finally, in global issues such as climate change and COVID, everyone is bearing the costs, so action can't be restricted locally.
> Uncertainty can be used either way: it can be used to try to delay action, or to try to motivate it (we don't know whether X will be a problem, but if it is, it will be huge, so we can't take a chance on not doing something about it). Both can be issues.
Both can be issues, yes. But in the discussed fields, again climate change, COVID, tobacco use, health effects of highly processed food, etc, scientific consensus is by a wide margin that X is both very likely and will deal enormous damage. So uncertainty in that direction is already very small.
Well, they also need to eat. So you'll have to pay them for it, as directly as possible.
The story is used to teach the wisdom of evaluating a plan on not only how desirable the outcome would be but also how it can be executed. It provides a moral lesson about the fundamental difference between ideas and their feasibility, and how this affects the value of a given plan.
Not quite. It's more in the line of identifying potential bad actors to not grant them oportunities to poison the well, waste resources, and outright sabotage progress.
> So you should intentionally bias your results if they don't fit the narrative you wanted?
Not quite. It's more in the line of exercise critical thinking when analysing said work, and there are doubts or extraordinary claims or editorialized nuances (i.e., claims that glasses are half full to undermine and attack findings supporting the emptying glasses theory).
> This gets to the core of the problem. It assumes scientists know the truth and the 'correct' studies.
The job of a scientist consists of gathering data, analising results, and help explain and model phenomena so that we learn more about a subject and understand it better.
As part of this job, experiments are made and reproduced, and observations are reported in studies.
Non-"correct" studies are those that include claims and data that are not credible, reliable, and are outright unbelievable. With enough work, some of those are recanted, but they still cause problems as supporters of fringe theories, conspiracies, and outright lunacy have been known to continue using them to support their wild claims.
As part of this job, experiments are made and reproduced, and observations are reported in studies.
As part of this job in areas where experiments can be done, yes. But in many areas of science, experiments cannot be done. Models can be constructed, but there is no way to validate them with controlled experiments the way you can in, say, particle physics. That means our level of confidence in models in such areas should be reduced; we should not even be saying that such models are "correct", because that level of confidence is simply not justified.
"First, researchers must learn to identify authors of research, and their relationships with industry and with non-profit groups that have specialized agendas."
Conflicts of interest can be useful to know, but this borders on ad hominem. The whole point here is to engage with the argument being made. As I wrote elsewhere, doubt must have a rational basis. If someone is sowing irrational doubt, then you can counter it by showing why it's irrational and unjustified. You can't stop others from spreading manufactured FUD, but you can respond to the FUD by showing that it is FUD.
"Second, scientists should consider what kinds of argument the data and conclusions serve."
So begin with an official narrative and official political ends and advise scientists to refrain from publishing anything that goes against that narrative or those ends? No, thanks.
Also, the author does not seem concerned about the pervasive low trust in our political institutions today and how enacting certain polities feeds into that distrust, even though that concern falls entirely within the bounds of things that she seems to think are worthy of consideration.
Almost nobody really spends much time with that other kind of doubt, epistemological skepticism. Theories, hypotheses, observations. Dense articles, years of reading.
So what happens when someone brings up climate change, or covid, or anything else? You can be sure they look at the former. They want to know who said what, and they want to know the interests behind it. Is this or that person a liar? What motivations might they have?
Peachy.
It's central to anti-vax discourse to find some small detail and amplify it to something big, then repeat the process with another detail again and again.
It reminds me of the web site "The Motley Fool" that would post an article such as "Should you buy AAPL?" that would always hem and haw and come to no real conclusion. Perhaps the reader felt they were being diligent by considering so much contradictory information.
Yeah I also hate it when articles give me the arguments for and against some issue and let me come to my own conclusions instead of just telling me what I should think. /s
If you make your own decision based on false, misleading, or partial information then it's only partially your decision because you've been manipulated.
That's the goal of the merchants of chaos.
Science is done by clearly and logically addressing doubt. Sweeping doubt under the rug and showing prejudice in which evidence is presented is antithetical to the impetus of science (a disimpassioned search for unwavering truth). I'm surprised this is published in nature.
Edit: tried to format the quote, didn't work.
The issue this article is talking about is you can very quickly generate hundreds of bad studies and outright lies that take decades to discredit. And even after all that effort, those studies will STILL be cited not because of the validity, but the narrative.
For example, vaccines an autism. We have so many high quality studies proving with as much certainty as you can in medicine that vaccines do not cause autism. Yet that's a claim that hasn't died off yet (And Mr. Wakefield's fraud study with the initial lie is STILL cited as if there were some sort of conspiracy to cover it up).
So what's the solution? It's easier to quickly lie than it is to experiment and prove. It's easier to falsify data than it is to prove data was falsified.
What other choice is there but to lean on consensus and reputation?
However, established science has been wrong before about things there was a consensus on. We should investigate evidence that casts doubt on consensus if there is some merit, even if it is painstaking. It's one of the less sexy and tedious aspects of science, nevertheless important.
The reply: "What's that got to do with anything I said? I'm saying <a rephrased version of one or more of the misrepresentations>." If they reply with a different misrepresentation, it becomes the Gish Gallop; they will eventually cycle back around to one of your rebutted misrepresentations, but by then everyone will have forgotten your rebuttal.
"And if it's just misinformation with no merit, use Hitchen's Razor."
The response: "See, they're not even responding to our evidence! They're silencing dissent!"
"We should investigate evidence that casts doubt on consensus if there is some merit, even if it is painstaking."
Which is one of the points of this article: while you are reconsidering the evidence for thermodynamics, you are not addressing the problem. They've won. This is why it took thirty years after the original Surgeon General's report to begin to address cigarette smoking. This is why humanity has done essentially nothing about climate change.
Established science has been wrong before, but when facing an immediate problem the current consensus is probably where you want to put your money.
As time goes on, this is something that only becomes more rare. How many established scientific consensus's proven wrong can you think of in the past 30 years?
That is the nature of science. We aren't going to discover that, all along the world was actually flat. Similarly, we aren't going to discover that global warming isn't real or evolution doesn't exist.
Some areas of science have unbelievable amounts of evidence of support. Yet you often find those facts to be challenged the most when the come in conflict with profits (the fossil fuel industry).
Rational doubt is the result of coming to know something credible that contradicts or undermines something you take to be true. This casts doubt on your prior belief. To resolve it, you must verify your prior belief and/or the new information.
This means that most of the time when dealing with adversaries you have to go against your usual scientific instincts, assume your position is correct, and reframe the conversation at a higher level about power, money, etc. Controlling where attention goes in these conversations is critical.
Refusing to engage adversaries at the technical level seems wrong, but is the only way to defend against the fact that science operates by default at a level of doubt that the normal population simply cannot sustain without being driven to apathy (which is the objective of the adversaries).
The adversaries we're trying to defend against will only have something else to point to and say "they have an explicit goal of manipulating public opinion to downplay climate/covid/round-earth skepticism", which isn't really that far off from what you're describing.
Trying to properly gauge how new information is processed among hundreds of millions of people just seems like an expertise that is totally orthogonal to having a deep understanding of a scientific discipline. What you're talking about not only seems wrong, but just doesn't seem like the best way to go about solving the problem.
The reason for this is that it forces the bad faith actor to enter the scene, they can't just slink away once the damage has been done and point back at the "doubt." It breaks the 4th wall in a sense, forcing the audience to realize that there is an active party with their own agenda in the scene.
Effectively all a scientist has to say is "The literature is an evolving work that reflects our current understanding. There are many factors that are involved in making public policy, and it seems that you are looking for a way to limit the influence that science can have on that policy to further your own goals that are driven by other factors that seem to be at odds with the public good."
It would be nice if they could also say "Anyone can read the literature for themselves ..." but unfortunately that is not currently the case.
https://www.thelancet.com/journals/lancet/article/PIIS0140-6...
"The field of agnotology (the study of deliberate spreading of confusion) shows how ignorance and doubt can be purposefully manufactured." Tomori suggests that untruth is asymmetric between corporate and government interests.
A scientist with this type of filter is foremost an activist.
I hope they all fail.