Why is no one asking to analyze the superconductors they claimed to make? Everyone's talking about replicating it by following their recipe, but isn't the proof in the pudding?
This actually doesn't just affect RTAPS or materials science in general. There are some scientists who just refuse to consider or use GPT-4 as SOTA, because in their view it's non-replicability means including it just isn't science. It's an extreme view, but the general sentiment is common. You could consider it a backlash to the reproduction crisis.