When a postdoc in my lab committed fraud, I had to face my own culpability
science.org
science.org
I don't have a *clue* what the solution is; but, asking ordinary people to turn into FBI detectives is not a viable one. It won't work in the real world, with real humans. It's a fantasy.
I sympathize with the outrage in this thread. But, go past your initial hot-takes: would you apply the same standards to yourself? Suppose you're in software, and one of your coworkers is sneaking subtle, obfuscated security bugs into your production code. Is it your fault if you fail to catch that? Would you consider yourself culpable if you did a code review and failed to notice some "Underhanded C Contest"-tier sophisticated backdoor? Because IMHO that is utterly impossible; and I think it's similarly impossible to catch data manipulation, reliably, if it's sophisticated enough.
Solutions need to be grounded in what's achievable.
There was no raw data manipulation, but fabrication of derived data. These kind of too-good-to-be-true results are easily auditable, if anything by replicating the experiment. The PI’s blind enthusiasm prevented her to do her due diligence.
> would you apply the same standards to yourself?
While I was in academia I checked basically every kind of raw biological data I was getting. Routine QC allowed me, for instance, to find contaminants in some of the reagents the lab was using.
I can appreciate this may have been more of a reflection than reprisal (with remediations no doubt made at the time) but if that was the case, would have been good to read it ‘unredacted’.
Had the falsified data not made it out of the lab I would understand this article’s approach - the author clearly uninterested in a fruitless smear campaign - but given “lies” are out there, would have been interesting to see exactly what it was and to what extent the findings proliferated.
Maybe the author didn’t want to give any more weight to incorrect information. I can only make assumptions.
A challenging and nuanced situation all round no doubt.
If you helped build someone’s reputation by not bothering to verify their work and just taking credit for your involvement with them, you have an uncomfortable but undeniable responsibility to be just as strident in getting out the truth.
This also happened several years ago, when there was even less honesty and discussion around this topic.
Naive and idealistic like the Wells Fago CEO who had no idea that his employees were actually committing fraud trying to meet his impossible demands.
The author was running a paper mill with underpaid postdocs students and presenting their work as her own with very minimal supervision.
The postdocs aren't students.
How do you know that they were underpaid?
How do you know that she was presenting there work as hers - science is collaborative in the extreme now. It is very rare for a paper to be produced by one author. At one time I wrote a few such papers and I was told that it was actually a black mark against me for a post because I was someone who couldn't collaborate!
there are always rationalizations for your behavior, but it may still be cowardice.
When the easy thing is cowardice (aka "strategy") why wouldn't you call out not doing the easy thing as exemplary?
I don’t see how one can draw that conclusion from reading one text she wrote. She can easily have written other articles about the case.
This article isn’t about the fraud or about its correction, but about her soul-searching years later.
I also think the article indicates she has worked on being transparent. She reported the case to the university integrity officer and hired a scientist to check the data.
She also writes “I had barely escaped the shame of having to retract a published article”, which I interpret (that “escaped” makes it a bit ambiguous to me; if that “barely” hadn’t been there I would interpret it as there not being a retraction) as that an article got retracted.
Just as greed got her there, cowardice keeps her there.
Again: I don’t see how one can draw that conclusion from this one article.
Also, IMO, there’s a huge difference between “behaving like a Foo” and “being a Foo”.
The former leaves open that they change, the latter doesn’t. Compare “(s)he killed somebody” with “(s)he’s a killer”. Who do you think can deserve parole?
It doesn't fucking matter, people will make the judgement _for_ them.
This sorry tale is why legions of us longer trust "experts". She cares so little about science that she did her best to ignore the possibility of fraud and then did nothing to stop it happening again. Academic culture is truly challenged when it comes to being scientific.
Also, academia works on references, sure you can get older referees but the referees would be suspicious as well as the person receiving. The reference culture can be career killing if you just worked with someone toxic as you're blind to the references, they assume the worst if your most recent supervisor isn't providing one etc. then even if you're good you have to apply to a lot of jobs and waste a lot of people's time submitting to portals and writing references.
The problem is when dishonest and no-skill researchers aren't fired or don't leave like Iddo Drori
What if not everyone has the courage to do the right thing all the time because they are just ordinary people and not the star of a movie? What if they are scared and we don't judge them for that?
A really big difference.
I would never recommend whistle blowing to anyone under those circumstances. It’s career suicide and may leave you personally devastated as well. The system is designed to protect bad actors.
I think we need to moderate both of these pressures. We need to stop the valourization of potentially high impact work - until it is high impact, and we need to emphasize the long value chains and problems with exploitation as well. A good example is the recent talk from John Burke about Quantum Computing and Quantum Clocks [1].
In terms of to the winners the spoils we have to develop a funding system that recognizes that people who make a single significant impact on a field early in their career are no more likely than anyone else to make further impacts. Indeed the more I hang around the edges of the research community the more I am convinced that there is a very weak correlation between any prior success and any future impact if you account for the funding that early winners receive. I feel that there are very many truly outstanding but unlucky researchers who are culled after 3 post-docs. I think that population is basically the same in capability as the folks who get tenure. We need to stop selecting so randomly - it's not working and it has bad effects (see this article).
In the past the way things worked was a "good fellows" club - where connections and patronage were what counted. In some parts of the world (Europe and Asia) this still has a massive effect. I think it's dissipated in North America and the UK but what's replaced it (savage competition) isn't really better - it just suits the political biases of the people funding the system.
[1] https://www.hpcwire.com/2023/12/19/dod-takes-a-long-view-of-...
Her name was on the papers and she presented the work at conferences.
If she was not really involved in the work, then it was scientific fraud to have presented it as if it were hers.
If you were so out of the loop as to not realize that no experiments were being performed and the data was being fabricated wholesale, then it is fraudulent to put her name on the scientific paper as an author and to present as an author. She is not conducting research but is a renting out a paper mill.
That kind of behavior needs to be strictly condemned
False authorship definitely happens a lot though but mostly with papers when 1-2 guys did the real work but 10 people are listed. Very common in many big departments.
The instinct on HN is to approach this as an angry blame game. But successful industries don’t do this: for example, the aviation industry performs root-cause analysis after each air disaster and then makes intelligent cost/benefit decisions about how to update processes to avoid future occurrences. In science it’s not clear what the right approach is on a cost/benefit level. Should we reduce scientific output by 50% to catch fraud in the first instance, rather than later on when important studies fail to replicate? Is that a good use of society’s limited resources? I don’t know the answer to this, I just want people to behave effectively rather than grinding an axe. We’re not getting out of the messes we’ve made on this planet without a whole lot of science.
That guy who faked all this can't really be thought of as a sophisticated bad actor, neither was he really gaming the system because it never would have worked. He was just leaping into his own pit.
Research needs to first move to being fully open access and end of tens of millions of taxpayer dollars going to journals. This is something tangible you can legislate. Then, you need to incentivize high-quality research; that's not easy to do at all, but you can do things if you have hiring power within your field I guess...
There's a lot being claimed without peer-review, and a lot of it is bullshit and wastes my time...
That being said, on crucial factor on such behavior is paperianism (a.k.a. publish or perish) and the lack of interest of the biggest journals to publish negative results at all (it could be anything, from short communications to just a database)..
It's so much harder to judge negative results than positive results. And it's so incredibly hard to attribute blame. Why was this result negative? Did you screw something up? Something very trivial you don't normally even report on? It's totally possible and that makes negative papers hard to swallow. Anyone can produce an unlimited number of negative results by being incompetent.
This is well said, I'm surprised I haven't heard it expressed before.
Assuming competence is rarer than incompetence, rewarding negative results will probably just drive the incentives even more to the extremes. Instead of outright fraud, everyone will get to hide behind "oops."
Nowadays, professors tend to play a middlemen role. Apply for grants, advertise results, and claim credit. Nothing else.
Most of the time, they do not come up with ideas, nor care about them or do any of the hard work.
Places like the Arc Institute have been born to cut PI middlemen out and get research out of this tar pit.
There is nothing special ahout the Arc Institute. It's a research institute that can hire professional researchers to do research, because it's not a university department that's supposed to train people to do research. The funders just are generous enough that the researchers don't have to apply for funding. Any organization could do the same with funders like that.
You can get a single renewal - but that's all. No matter what you are done after 14 years.
Arc is indeed special because all funding is internal, just like it was at LMB or CSHL during their golden years. This encourages small groups where everyone does research, instead of creating a class of middle managers.
> Phase 1 of the institute involves hiring 10–15 Core Investigators, each of whom may employ 10–20 trainees, researchers, or engineers.
Those are large groups by academic standards.
The middle manager structure itself arises from many causes. Funders like competitive grants, because that gives them more control over the research they fund. Universities are in the business of training the next generation of researchers. And universities save money by hiring dedicated teachers instead of professors, leaving a smaller number of research-active people in charge of the trainees.
Sounds like this person was part of the problem if their idea of "supervision" was flying around taking credit for their postdoc's fraudulent research while being so out of the loop that they didn't notice the postdoc fabricating data whole cloth.
If you know you can go to jail if your postdocs fabricate data, I bet you will be a lot more thorough in checking all the original data.
The problem of scientific research is misaligned incentives. There is tremendous upside for publishing novel ideas and very little downside for fraud, especially for the PI who can pawn it off on the overworked, underpaid post-doc.
We as a society don’t actually value the discipline of science or the pursuit of knowledge. We value being first.
The discipline of science is exactly how you get knowledge in a society that doesn't value its pursuit. It's an imperfect process of imperfect individuals that usually nevertheless arrives at knowledge eventually.
Fraud is just another part of this process. Additional checks for fraud or errors cost time and money. Effective checks would basically mean science costs 2x as much. How much fraud can we tolerate? Is it worth spending this much to reduce the amount of fraud compared to investing in more research? Can we slightly change incentives (as opposed to inventing some utopia that cannot be implemented) and thereby reduce fraud more cheaply? The academic discipline has been changing ever since and will continue to change and progress.
Incentivizing reproducibility would be hard as a grassroots effort, but would be enforcible if it were tied to funding. Even if only a small percentage of published studies were reproduced, and only a small percentage of them were found to be fraudulent, the disincentive for fraud would be present. We do not need more Andrew Wakefields.
> Effective checks would basically mean science costs 2x as much.
By that logic, we would need to enforce speed limits by having one police cruiser following every driver.
In this case “John” probably understood this about him and was likely just giving him the validation he so desperately craved.
I like how he claims the art of science to be a sacrament yet can’t be bothered with the actual work. A complete bastardization of the actual core of the work.
So, I guess my point is, a good CEO would eventually figure out if work is bogus, but they'll probably be the last to know. BTW, noticing the data problems when working on the draft publication is literally the first opportunity a PI would have to really see all the final data in one place. Conferences are 'low stakes' and it's not unusual to present some preliminary and/or partial data.
I know this opens a HUGE can of worms if you really think about all the repercussions (e.g. who really deserves Nobel prizes and awards?), but that's a story for another day.
Whoever's at the top has culpability for this type of fraud. Either they knew or they should have known.
Professor would be responsible of fraud if they learn about it and ignore it.
The sad truth about a lot of science is that science is built on trust. The psychology replication crisis is proof of that, there are so many ways to manipulate data to make it look like you have a result and also so much pressure to get a result that people resort to the former to get the latter.
There are plenty of historical scandals about how scientific fraud has taken way too long to investigate, people like Victor Ninov and Hwang Woo-Suk are two examples of just how far fraud can go before it's found.
The article here is comparatively tame compared to how far Huang and Ninov got.
But in this case funding doesn't seem to be the problem. The author says why she didn't check: she wanted to be famous.
It'd be pretty fair for this person to be held partly responsible if he was presenting it at conferences, which outside of exceptional circumstances (eg the postdoc was supposed to present but had to cancel with very short notice), would justify the assumption that he was familiar enough with the work to speak on it.
I love how the author perpetrated scientific fraud and is playing the victim.
Part of the responsibility of a PI is supervision. The author put their name to the paper and the presentation. It is his responsibility to verify this.
Also what kind of lab culture did they create. Was there a super focus on discovery at all costs? Was the author just exploiting the post docs instead of actually properly supervising and mentoring them?
It kind of reminds me of the Wells-Fargo CEO who created a culture of high demands and no supervision then acted all surprised and innocent when fraud occurred. I think the people at the top of the hierarchy need to receive more blame, rather than push blame to the overworked, underpaid lowest person on the hierarchy.
The point is that trust is a major component of scientific work and how it functions collectively. A effect being that when that is violated a lot breaks down with a god amount of collateral damage.
With increasing complexity in research and pressure to produce and publish more, it’s a growing weakness.
Bottom line is that team work and trust are now indelible parts of research in a culture predicated on individual success and contributions.
Honestly not sure how science adjusts.
When writing papers and presenting at conferences, the PI was all about how he was an integral part of the research and if you asked why he was presenting instead of the post-doc he would have talked about his responsibilities to supervise and guide.
Once the fraud came out, he is just a poor victim who can’t be expected to know the post-doc wasn’t even using the equipment and was making up data completely.
The CEO gives the talk about the awesome product because they set the roadmap.
Benefits flow uphill, blame flows downhill is literally how any hierarchical organization works.
Now, you might want to say that science shouldn't be hierarchical, but we don't have any flat organizations like this that involve the kinds of mentoring and training required to build new scientists.
For example, a ship’s captain takes ultimate responsibility for any collision or sinking, whether or not they were actually steering the ship. There was a tradition of the captain being the last one to leave a sinking ship.
Many cultures had a tradition of executing commanders that suffered defeat.
I think our culture is an anomaly where blame does not flow uphill as well.
This isn’t subtle fudging of numbers or something that can be harder to detect.
And that is part of the problem. Having gone through a phd, this unspoken religiosity that underlies scientific research where you are expected to be monks for science contributes to stuff like this.
Some architect grads I knew once mentioned hiding their building models in the classroom ceiling in the leadup tp their final exams. When I asked why, they said that there was a non-trivial risk that if you left your model out in the classroom other students would damage it to let a leg up on the competition, and the more ambitious the final project the greater the risk. In my innocence I was quite shocked, but as so often, once you become aware of such behavior you start noticing it in many other contexts.
At least, some do, and the better orders are built that way. There are plenty of bad ones, too, as I'm sure we've all heard, who don't do any of that - Who lord their pledges of service to the lord over those they consider lesser. That style seems to be more what modern academia is following.
Require the postdoc to repeat the experiments in her presence could be one of the several solutions available
The concern of the author is ultimately one of status, preeminence. Of course people motivated by prestige will not always be trustworthy. Her sin isn’t being too trusting, it’s a lack of self awareness.
The PI is Rosalind A. Coleman. I did not thoroughly investigate the preferred pronouns of this individual but canonically Rosalind would be assumed a 'she' and the top Google images returned for the name present as female.