Nature rejects double-blind peer review - how corrupt is academia?
science-community.sciam.com
science-community.sciam.com
Usenix, on the other hand, is is "single-blind" (if you want to dignify this with a name).
It makes a huge difference. Forget about gender bias. The real problem is bias against newcomers. I was reluctant to write anything negative about well-known researchers. When you're doing a bunch of these, you don't have a whole hell of a lot of time to track down cites and evaluate experimental results. So your default is going to be, people who could kick your ass in your field are getting good reviews.
So effectively you get single blind (if that, it is often pretty obvious who your referee was if you know the writing style or the referee keeps citing papers by the same author) . However, even though it often doesn't work very well in practice, not doing it doesn't work with perfect certainty.
Oh, wait. No he wouldn't. ACM SIGCOMM is double-blind. Yeah, I have no idea why everything doesn't work that way.
It isn't necessarily "corrupt" to reject double-blind peer review. In my experience, most scientists who are qualified to review a paper will be able to infer the name of the researcher behind it, based solely on the content.
This is particularly true in areas where software packages or novel algorithms come into play, because people tend to name their ideas for maximum recognition. It's silly to hide the name of the researcher when the paper refers to their pet algorithm a dozen times by name.
I confess that I've done a reasonable amount of graduate work, and I work at a well-known college (staff, not faculty), and I was genuinely surprised to learn that most reviews aren't double-blind. It seems to me to make more sense as the default option.
But again, I don't disagree that the submitter is hyping the situation with that head. The situation isn't necessarily "corrupt" -- but I can understand the inclination to interpret it that way.
In my experience, most scientists who are qualified to review a paper will be able to infer the name of the researcher behind it, based solely on the content.
Your point isn't just anecdotal, the original Nature editorial mentions a study: "Referees could identify at least one of the authors on about 40% of the papers, undermining the raison d'être for double-blinding."
http://www.nature.com/nature/journal/v451/n7179/full/451605b...
But sexism is probably a problem with female names one doesn't recognize, not females whose work one is familiar with (anecdotal, but I'm sure I could find studies on prejudice/discrimination), so double-blind review would still help.
Still, we're talking on different premises: I think it's important both for publishers to strive for fairness in publishing and for researchers to demand a unceasing effort towards general progress in publishing. The real problem is a lack of dedication to thought about the best way to organize research, which, if I understand correctly, is the biggest value added by the journals. Why is it that the closest thing to thinking about organizing research on a macro level is one of Nature's 17 blogs (is it really just as important as the Avian Flu)?
Why is there so little thought about how it is we organize our research? Is it just because old business models stand in the way? Is it because those that benefit from the status quo have undue influence?
But this isn't to say that the system of publication is perfect. Why don't we innovate more in how we organize research on a macro level?
http://www.scottaaronson.com/writings/journal.html
It seems that journals (and textbook publishers) give the authors of intellectual works prestige and bragging rights in return for billions of dollars worth of intellectual property. The more valuable the intellectual property you give up, the more bragging rights you get. The entire industry reminds me of Tom Sawyer's whitewashing trick:
Tom said to himself that it was not such a hollow world, after all. He had discovered a great law of human action, without knowing it – namely, that in order to make a man or a boy covet a thing, it is only necessary to make the thing difficult to attain. http://www.pbs.org/marktwain/learnmore/writings_tom.html
Or is there something I not getting?
Dangerous.
Double-blind seems to me to be an attempt to try and cover up the much deeper flaws of "peer review". Peer review doesn't in practice mean that a peer-reviewed article is 100% correct, and that legions of scientists have honed every sentence. It means it got past the prejudices of a few reviewers, and (unless the reviewer is unusually committed) means that it didn't contain anything that screamed "obviously wrong" on a quick read through. When I get a genuinely good review (in particular if it finds a flaw in my work), I find it immensely useful, but these are sadly in the minority. IMHO the greatest reason why new-comers to the field find it hard to get papers accepted is because their ideas have a higher chance of grating against those held dear by the established people who act as reviewers; this is such a fundamental flaw in the system that fiddling with double-blind barely even counts as fiddling at the edges.
Given all this, it greatly amuses me when in North America to see products advertised as being based on peer reviewed science.