343 karma · joined December 27, 2015
One way to cut out the middle man would be to convince journal editors to run sibling journals alongside the existing journals, so for each "Transactions on XYZ" there would be an "Open Transactions on XYZ" (as close in title as is legal). Importantly, each sibling journal would be run by the exact same academics (who are doing the real work on tax money anyway), and according to the same process as the original journal, just without involvement from a traditional publisher. PDFs would be hosted on a site like arXiv. The goal would be that submitting to the open "sibling" would be the obvious rational choice (same people, same decision-making, no fees, open access), which in time even the funding agencies and tenure committees would have to acknowledge.
"About 53,000 results."
However, I do think there is a lot of incremental, piecemeal type of work that over the years could amount to a decent step forward. It's just that currently, from looking at the code behind quite a few published papers, the statements often just cannot be trusted enough to actually build on these works. It is my view that some subsubfields in CS sustain themselves by avoiding the most pertinent questions, because their answers would reveal that the entire subsubfield has been superseded, or was never that promising to begin with. Unfortunately, that type of noise generation is actually more profitable than a single paper saying "nope", although the value of the latter in terms of knowledge generation is enormously high.
The main issue with that right now seems to be the lack of real incentives: those badges are nice to have, but in the end you're evaluated by publications in highly regarded journals and conferences, citations, and funding brought in. Those things of course tend to let people focus on novel, fancy, exciting work, instead of the time-consuming process of making things easy to replicate by others, or even replication of other people's experiments. Incentive-wise, the publication business follows the principle of fire-and-forget.
What's needed, but I believe very difficult to introduce, is the strict expectation of independent replication. That would mean replication as part of the core review process, which would A. create a lot of work for reviewers B. initially reduce the attractiveness of whichever conference introduces it first.
One thing that would be easy to introduce in computer science would be to make it mandatory to share all code used in experiments - if you cannot/won't do that, you should not able to take part in this game.
The title should be appended with ", and failing".
With consciousness, "the experience of the trick" and "the trick" are one and the same: if I have a "first person experience of reality" (which I have), then I struggle to see how it can be viewed as a trick. Due to the property of consciousness being a subjective state, it seems that eliminative materialists claim that even the EXPERIENCE of the rabbit being pulled from the empty hat is an illusion, which to me is just nonsensical (but I assume that with suitable definitions you can work around that).
Some groups are also trying to target sequential, parallel and, say, GPU execution from the same model specification language, which could actually help with the usability of running such simulations in practice.
A view held by some seems to be that since even the empirical observation may "perpetuate" the situation, stating it is "problematic" in itself, but I don't suppose this is what you mean here.