I can't imagine how frustrating that can be. And then you have to do it with something you don't even know works. Kind of like dealing with obscure retro computers. Does it still work? No one knows. What does it do if it works? No one knows. Can it even function or are parts missing? That's right - no one knows.
It is why I quit experimental physics.
Filament is too wet, the air is too cold, a batch of filament might behave wrong. Or everything goes 99% right and the axis of the moon and the constellations are off and it ruins your entire print after 57 hours. Then you start again and it breaks at 59.5 hours. I’m sure it’s not as hardcore as synthesizing superconductors but the real world is incredibly messy and imprecise.
Everything from humidity and altitude to undocumented "magic tricks" (eg baking something in an oven under vaccuum for a week to get.rid.of.all.the.water.)
I heard anecdotes that experiments were sometimes literally only reproducible in one exact lab because reasons.
Turns out there's just as much art as there is science in experimentation...
If a prerequisite of publication in a top tier journal was someone having replicated the work… anyone at all… then the quality of write up would improve dramatically because all the stuff that never gets written up would be written up so that the second lab costs them less money to do the replication work, so the second lab doesn’t spent a month failing because they didn’t bake the powder in a vacuum for a week before performing the entire synthesis under dry nitrogen purge when the methodology just said the powder had been dried and the synthesis was performed at ambient pressure in a zero humidity atmosphere…
I would expect pairs of labs to gang up, with one of them giving the other the details so that they can reproduce the result, and the contents of the publication staying more or less the same.
Reason is that everybody wants to prevent others from being able to build on one’s work faster than one can do themselves.
Even if the lab you give more information isn’t run by a buddy of you, having a single competitor is better than having the whole world compete with you.
For example, in this case, people will start cooking all kinds of variations on this stuff to find one that’s easier to produce, allows for higher currents before losing superconductivity, doesn’t have lead in it, etc.
A darker comment: the non-replication of results implies that nobody's actually making use of the science output, and an alarmingly large fraction of unreplicated positive results are simply a waste of time.
For a SciFi take on this see the section "A Note on Governance" at https://eldraeverse.com/2018/05/25/approach-vector-2-2/. Specifically, the "Dean of Evidence".
It's rare for researchers to get the budget to replicate someone else's work - this case might be one of the few exceptions given that everyone and their dog want to be the first one to show the world a successful replication. Hell, there are Youtube and Tiktok streamers on the task as well, that way you know just how nuts everyone is going.
Oh, you want to document things well enough that people can build on your work and give you citations eventually. But if you've just demonstrated a groundbreaking technique for Foo and the obvious next step is to test it on Bar, you've got an opportunity to get your lab two papers instead of one, and all you have to do is less documentation?
The super power of modern technology is the ability to perform precise steps on a massive scale and basically forever.
Obviously it takes a lot of effort to keep the machinery running but still, the mere fact that it's running in the first place blows your mind if you think about it.
Modern Machinery multiplies the impact on the world of any human who operates it.
Industry is all about doing it cheap, consistently and at scale. So by comparison you don't want any flourish or special conditions that take lots of practice and super skilled operators.
The magic of industrial engineering is figuring out how to go from research to scale. But the flipside is all the crazy stuff that is achievable at the frontier that never gets productionised
vacuum oven also works great for drying 3d printer filament!
Usually they understand directly because this is something they can easily relate to.
Samsung 3nm had a yield rate well below 20% back in early 2022, and that's not unheard of while still in the development phase. To be economically viable the yield rates have to be around 80%, so mature nodes can be expected to be in that ballpark.
It's still a failure to produce a part that matches the full design.
That wasn't my experience, in either high school physics or undergrad electronics. I hated keeping a lab book (just wanted to 'do' & see results I suppose) but the emphasis was always on recording as much as possible to understand what's important and what happened etc. when you review later.
I suppose looking through another lens you can call that an expectation of repeatability, but it's just a matter of emphasis isn't it? You know it might be hard to repeat, so you record as much as possible about the setup & process to remove variables and control what needs to be controlled (especially if you don't yet understand what that is, or the full scope).