If I was an academic working on this, I would be following the Sagan Standard and triple checking my results before claiming anything.
I think we are all suffering from 24 hour news cycles. The work in China and now Varda is very exciting but they are warp speed developments.
Instead of a few anonymous peer reviews, you get the entire planet to replicate. Moment you get something meaningful, publish it on arxiv. Quantity, not quality is king. Anomalies are drowned out by large samples. Questionable methods get mass debated in public.
Scientists are dependent on public funding, why squander the biggest moment in pop science for literal decades?
Now this won't work for 99.99% of research. But top tier research will probably get published on youtube and arxiv in the future...
By people who don't know what they're talking about.
You're seriously underestimating the level of expertise that it takes to professionally assess most research. It wouldn't be unusual for there to be a small handful of people with that ability in the world.
This works just as well with less exciting tech, because the point is that we collaboratively learned how to build something.
NASA can't take risks and seriously innovate anymore because even intentional explosions will be passed off as failures, we all experienced the sheer madness of the covid years, similarly anything nuclear brings complete randos out of the woodworks claiming absurd things about its dangers.
Not having some amount of gatekeeping just lowers the bar too much and introduces so much more noise.
I can see how this would be a very controversial subject. Discouraging scientific participation? That's a tough pill to swallow without a lot of justification.
That's not really the case though is it? Doubting someone's credibility would simply mean ignoring their results. But withholding information is something else entirely.
When I mentioned gatekeeping I was specifically referring to how there's this formula that was kept secret since 1999. At some point the potential significance surely became apparent, and one of the only speculations I can come up with to justify that would be gatekeeping; keeping the information out of the hands of the filthy commoners for reasons.
Maybe it wasn't gatekeeping. If not I'd sure as heck like to know what it was.
Was it withheld from the public? Eh... yes? Kind of? Because it was only ever published in a journal - probably Materials Letters, but this was a long time ago - that you would only have access to if you were a graduate (or ambitious undergraduate) student with plenty of time to read in a university library, or a specialist in the very narrow field that journal was for, somebody with a membership included subscription...
This isn't gatekeeping, this is, to be blunt, profit motivated hoarding by a handful of publishers in the academic journals business. And this is the thing that arXiv.org and other pre-print venues are actually having an impact on. I, for one, am strongly in favor of academic information being widely available. I'm not as much in favor of people who have not demonstrated their competencies in something that requires a great deal of both knowledge and skill feeling entitled to being given a platform for their (usually laughably clueless) proposals. If you've done enough work to have a tested hypothesis, that's different.
However, what I think happened here is that they weren't able to work on it for a while, and if say, they didn't feel confident in their findings back in 1999 and only got around to being able to look at it again in 2017, it would make sense that their intent wasn't to gatekeep, it had just become one of those "we'll get around to testing it one day" type of projects everyone has. In this case it just potentially was a pretty massive thing to put off.
So no withholding information at all. But on a more general level if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster. The reason we do science is because we are trying to understand things just posting your random results would just give everyone information overload, because you would know what to focus on. Lk99 is actually a great example, the material would have completely been ignored by most (maybe even has been, not sure if they published about it previously?) if not for these recent results. Moreover because the results were published before the authors were confident about what they had, they have been subject to lots of ridicule and accusations of fraud. It might turn out alright in this case, but something like this can be career ending if it turns out to just be an experimental error.
I really do hope it's something innocent like this.
> if everyone would be posting out every little bit of information they produce during their research instead of publishing articles it would be a disaster.
I'm not sure it would be any worse than it already is. I don't see how we could achieve any more bombastic headlines than we already get.
So I don't think asking about credentials or asking about references is gatekeeping. It's putting a statement into context. If I as a random asshole say "this isn't a superconductor" you as a reader should want to know where I'm getting that opinion from rather than just taking my statement at face value.
Edit: According to this it was just an unfortunate 19-year hiatus. (Yikes.) https://twitter.com/8teAPi/status/1684385895565365248
Does it mean that grant money are distributed by people who are unable to "assess most research"?
Of course, we’re often working on a tool to help make tools for other scientists, so that sort of thing is hard to explain to the general public, but ultimately it should terminate in some results that actually have obvious value to society in general.
> By people who don't know what they're talking about.
I'm glad I'm not the only one who finds all these public mass debaters disgusting.
- ordinary ppl more or less understand the importance of RTS
- a visible and understandable effect (Meissner) can be shown on successful replication
- the materials required are easier to understand, but the synthesis procedure is tricky, and purity is important
- The skills of chemists comes into play, leading to kind of a Breaking Bad feel
"Top tier science" is already published on arXiv.
The future happened back in 1995 or something like that.
> Quantity, not quality is king.
No, quality is still king. We don't need videos of flakes standing on their end we need someone who has been working with superconductors all their lives who is competent enough to measure zero resistance across the sample. If one of the wild theories is right we need someone who actually knows how to prove it and not just sound like they're intelligent by talking about 1-d superconductors.
No, this is a new face for peer review. Existing peer review processes have stagnated in the information age, possibly with good reason. There are a lot of advantages to more immediate review of papers and data, and also to bypassing the systems of qualifications presently used to choose who is a valid reviewer.
The reaction I've seen from most of the scientists has been pretty negative on the papers. The originals aren't strong papers. The chemistry has issues: https://nitter.net/Robert_Palgrave/status/168545015680691814... (unbalanced equations, starting materials have pretty different element ratios to final products). As for the main claim, note that LK-99 seems to be a poorer conductor than copper wire at room temperature: https://nitter.net/bedoya_pinto/status/1686848392616423425#m... which is the kind of thing that should really cause a record scratch and make everyone go "um, I think you did something wrong there"--it's something that absolutely would be caught in peer review.
It also seems like it has at least pretty strong diamagnetism, which while not a demonstration of superconductivity is both somewhat interesting and gives a vivid demonstration that's amenable to social media.
There is no conclusive proof that this is a superconductor on the replications, but the evidence has been on a different level from nearly everything else you'll find on Arxiv since the beginning.
At monopolar magnetic fields weak enough to come from a permanent magnet is a lot rarer.
Almost all superconductor claims come from measuring magnetic resonance or direct resistance measurements. Both are noisy things to measure, and won't get you reliable results.
The peer review system is broken but I think we still need some sort of structured system in addition to this “hey world, check this out!” method.
Peer review was never a substitute for replication in the first place. In this sense we've been "post-peer-review" the entire time.
Yeah, that's not how it works.
At practice, anomalies are hyped into everybody's attention, and large samples are drowned out by lack of novelty. You don't need questionable methods to get bad results, you just need quantity.
All the things that are happening are great, and this may be an astonishing discovery. But don't put more certainty on it than it's warranted.
Notably, peer reviews typically don't involve reviewers trying to replicate the results. So we've essentially skipped peer review (at least temporarily) and went full speed ahead with the post-peer-review process.
A twitter post isn't peer review, but it is a nice way of sharing part of the process. A video etc. will help others in their attempts to replicate.
Counterpoint: It's better that a lot of people know "Hey, we might be onto something interesting here" early on.
So they'll quietly slog away trying and retrying experiments, checking and rechecking their data before finally saying anything.
As we saw with other previous big things, like the first gravitational wave detection, they took some time to make sure that they were right.
I think that if it turns out to be real and national lab experiments prove that out, we'll be hearing rumors circulating within the field some time before an official announcement, just like how there were rumors about LIGO's detection circulating for a month before the announcement.
Yet not a single replication! China has gone through multiple failed and successful replications so far. And the first US replication is from an amateur.
If LK-99 works out, expect some congressmen to use this as a bludgeoning tool against the state of US public science.
"A researcher from the Institute of Physics at the Chinese Academy of Sciences (CAS) declined to comment on LK-99, telling the Post that even taking the issue seriously would be ridiculous." https://www.scmp.com/news/china/science/article/3229778/coul... (It's unclear to me whether this was before or after the HUST team published their video.)
I don't think it's so much "China good at science, everyone else shamefully bad," but that some institutions (including in China) are more risk-averse, because labs who're already working on something they expect to succeed are less likely to benefit from dropping it to try something unproven.
Usually, when the Chinese government is confronted with an unexpected development they want to suppress, the opposite happens: official spokespeople clam up, nobody has a statement ready, related keywords get censored more or less effectively on social media, until an official narrative is revealed that doesn't withstand further scrutiny but survives anyway because such scrutiny is censored as well.
So no, it's pretty much not the playbook they'd run if they were trying to discredit it.
- challenges in practical and reliable
manufacturing of LK-99
- challenges in engineering w/ LK-99
- challenges in finding better materials
than LK-99 using similar approaches
If I were in a position where I could devote funding and researcher and lab time into LK-99 research, I might well quietly let others to do the replication work while having my team quietly research practical manufacturing of LK-99 so that we could a) beat everyone else to the punch on practical and reliable manufacturing, b) get the patents for (a).And yet researchers in other countries managed to find the money this week. That would seem to point to a real relative weakness that's worth thinking about.
Whether it is the result of gatekeeping, bureaucracy, academic squabbling, or something else, a cranky (and hilarious) Russian did better, faster work in her kitchen. Even putting aside professional scientific dysfunction, that seems to indicate a strategic cranky kitchen chemist gap.
Well, the work is happening right now.
You seem to want to make it sound like impatient kids being unreasonable or something, which is a ridiculous read.
It is more a matter institutions becoming irrelevant because they literally can't keep up with their peers. Which brings me back to,
> Seems kind of stupid to do chemistry in your kitchen.
When the institutions in your country become incompetent, that's what you're left with.
A bunch of professors belonging to a hastily formed academic committee are trying to monopolize the public debate, quibbling about errors in the arxiv paper and demanding that Lee & Kim turn over samples of LK-99 because the big-name professors are obviously too busy to make their own. It seems that their first priority is to avoid a repeat of the Hwang scandal than to touch any novel research.
Don't you think in those conditions it's at least a little bit reasonable to demand samples?
No. Because ultimately they don't owe anyone anything outside of the standard scientific process. They want to get the peer reviewed article published, and have stated that if people still want samples after that they will provide them.
Half of twitter shitposting about FLOAT THE ROCK and a bunch of curious scientists and engineers attempting to replicate this doesn't fundamentally change this equation. If it's a superconductor now, it'll be a superconductor in 6 months.
None of the media hype or unwashed masses treating this as science entertainment should significantly impact the process they are going through. Assuming they've got an RTAPS, they'll get the Nobel Prize regardless of whether or not they satisfy everyone's curiosity right this moment or a year from now. Assuming they don't have one, well, that'll get found out too.
I and everybody else would love them to hand over the samples for external testing, but it’s their samples so they can do whatever they want with it, and the rest of the world just has to pound lanarkite while we wait.
I have a hunch that this might have something to do with the late professor Chair (Choi?) who came up with the idea back in the 90s, and whose last wish his disciples claim to be following. Chair was a sort of outcast in the superconductor research scene, and the methodology his disciples have been using are also, um, unorthodox at best. Someone might stand to lose a lot of credibility if the verdict goes one way or another. We know there's been tension even inside the team, as one of the three men named in the first paper was dropped from the second paper. At this stage, I'd be more concerned about these internal tensions and personal grudges than any attempt to manipulate the public at large.
They say they want to share samples after they get a peer reviewed paper published. That's not a weird position to be in. If it wasn't for the hype around this, they wouldn't be in this position.
Let the process play out like it normally does, and if none of the replication attempts pan out, they can provide the samples after the peer review. We'll still care about RTAPS even if it takes another year for a sample to be provided.
Wait for the peer reviewed paper if you are this concerned about it.
The "successful" replications are partial. No one knows how to make a large enough sample of LK-99 that can be tested to definitely show superconductivity (or not) at room temp and ambient pressure.
IMO the most bullish research done yet is the theoretical research.
I hope for the same here in Germany. It's way past time we actually deal with the sorry state of science funding and academia in general across the Western world.
They are still busy getting approvals from three layers of management and one group of lawyers.
I'm pushing back against academia because I think the system is pretty much a mess. Academics believe that we got all the nice technological innovation because of academia. I think it is despite academia. Most money going there is just wasted on writing not what you think is right but what you think will be published, waiting for peer review, and other bureaucracy. The main problem is that academia works with the belief that science needs to be rigorous since bad science might damage their reputation. However, this is how governments think, but not how scientists should think! Would the world be a better place if any new website, company, or YouTuber should be reviewed by peers first? No. Just like science, these are strong link problems [1].
[1] https://www.experimental-history.com/p/science-is-a-strong-l...
The reason the Varda team even took this long is because they couldn’t get red phosphorus.
Of course it could all be faked, but she is prima facie attaching real, professional identities to her claims.
Confirmation bias is a hell of a drug.
https://nitter.net/iris_IGB/status/1685774956330635264#m
They won't publish a preprint on their version because they think it would be "unfair"!
https://nitter.net/iris_IGB/status/1687020011548770304#m
Every post this person makes throws up more red flags. I have no idea why people believe any of their claims besides "haha anime girl"
She seemed to have problems with the efficiency of the original formula, which is why I believe she doesn't believe it's replication what she produced may in the end not be LK-99.
It seems like she's in the process of getting X-ray diffraction analysis (XRD) done.
There has been several fake videos placed out there on the Internet.
There is a quote by jay-z I'll paraphrase
" Men lie
Women lie
But replicable science don't lie. "
The mixture of USSR tweets has patriotic Americans so ruffled that some can't see through their disbelief and rage.
Yes, it isn't replication, and the only proof that her modified substance does anything interesting is a photo of a single grain suspended inside a small tube. She hasn't written anything clarifying the process from her vague twitter thread, she hasn't posted a video showing the sample's behavior (which would be better than nothing), she hasn't shown any measurements, and when people ask for these things, she gives unconvincing excuses.
And yet every thread is full of people saying she was the first to replicate. The USSR tweets are a little eyerolling but not the main issue
That person’s twitter feed reads like the howlings and scribblings of someone in a manic depressive cycle. I’m a little surprised _anyone_ would take them seriously.
Check out her twitter for some real fun rants @iris_IGB
World first public replication
As much respect for her as I have & as much I’ve enjoyed watching this pan out, a U.S. DoE affiliated lab or other nation states’ equivalent likely did something in the same timeframe.
People working in those labs are unfathomably smart & talented.
I don't doubt that the people working in these labs are very smart and talented, perfectly capable of their own replication attempt. But would they rush to try replicating it immediately after the paper's publication?
It does show genuine scientific curiousity from Andrew and his team(they might just be along for the ride).
If more company bonding events could be live streamed/tweeted experimental replication attempts of novel compounds instead of happy hours.
The world would be a stranger place.
We're not talking about a vaccine.
In my experience though, if he had made any effort to link those two things prior to doing this - e.g. by proposing this as an internally sponsored marketing stunt - it would probably have been rejected.
- using company resources, such as time, hardware, or office space, unless otherwise stated.
Clearly the case here, but my understanding of this law doesn’t align with how you described it.
- batteries + touch screens => iPhone
- batteries got better => Tesla
- reinforced concrete => pretty much all the worlds buildings and bridges
- neodymium magnets + gyros => drones
A room temperature superconductor... well, that changes things on a completely new level. Order of magnitude smaller losses plus order of magnitude higher magnetic fields? OMFG can we build SciFi things from this if it pans out.
So yeah - we are in a hurry. If this pans out, there will be a massive shift in how pretty much anything is made. And the reward for the people who can figure it out first are insane, in terms of potential value created.
But eastern competition is fierce, and the western world is mired in esg and bureaucracy.
Something is rotten at a general level, and if its not fixed soon, this trend of lagging behind will also start manifesting where it starts to hurt.
But think about it from a company/wealth creation perspective. Are you then really sure the correct course of action is to take it chill?
He understands how to market in the social media age.
It’s very hard to redeem academia in this example.
It's a slow moving process, but it works.
A better explanation for the slowness of the national laboratories is they their word will be taken more definitively on this issue than anyone else.
They are the ones with reputations and have to answer to critics in the private sector, amateur sector, and in Congress.
I think their slowness is an encouraging sign, it means LK99 isn't easily debunked.