Do you really think that if you were to look at most research done between 1897 and 1922, the overall quality would be higher? And that there would be less social factors competing with the integrity of work?
Do you really think that if you were to look at most research done between 1897 and 1922, the overall quality would be higher? And that there would be less social factors competing with the integrity of work?
How long has it been since replicating someone else's study to validate the results was routinely part of the scientific process?
>The replication crisis is an ongoing methodological crisis in which it has been found that the results of many scientific studies are difficult or impossible to reproduce. Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially of substantial parts of scientific knowledge.
Science doesn't exist in a vacuum, it still needs humans to do grunt work and those humans need to be paid, and there isn't much money in replicating an existing study and saying "yep, that's what we thought".
I'll add the other sentence from the first paragraph of the source above.
>Because the reproducibility of empirical results is an essential part of the scientific method, such failures undermine the credibility of theories building on them and potentially of substantial parts of scientific knowledge.
I'm asking how to fix it. How do we incentivise reproducibility?
One thing we could do is mandate that some portion of all grant money has to be given to independent researchers who will work to confirm your findings. I could imagine some downsides to doing this, but at least it would put money in play.
Also, another problem is that the people doing research are usually grad students working toward a Ph.D.. No one wants to do a Ph.D. confirming someone else's results. You'd need some other workforce to do the work of reproducing research. Again, doable but there needs to be money allocated for this task.
Right now, far too often "review" is a rubber stamp and replication never takes place. That's because often science isn't really being done. If you're Tropicana you might happily fund study after study after study tweaking it each time until you get the results you're looking for so that you can get "OJ may reduce risk of cancer" into the headlines, then bury the results of all the research you funded that contradicted that, but that isn't science it's just advertising. In a better world, anyone involved in that kind of shit would be blacklisted as disreputable if not charged with something.
Research that isn't or can never be replicated is just barely better than speculation, and not really worth much of anything. If someone wants to fund science, we should be insisting that the process is actual science and the results are meaningful.
But again, this is an economic problem. In a perfect world, we'd have an infinite fund for doing science and you couldn't publish a paper until your results were reproduced.
But we live in a capitalist society where incentives are profit-driven (mostly). That's a reality regardless of whether you think it's good or bad.
See e.g. “Leviathan and the Air-Pump”
I suspect yes, because the poor research was simply not be being done. Science was not a career, there was no pressure to publish, it was the pastime of an elite few.
One of the critiques I hear about Academia these days, even in hard sciences, is that it is now significantly more dominated by the sons and daughters of elites (who don't have to take out loans and can afford unpaid research opportunities etc. etc.) So it might be on its way back to that.