We need GitHub for science. But that's not enough. It needs to be combined with a mechanism for peer-review and publishing that funding agencies will find acceptable--that's the key.
If your background is in not-academia, you may well be forgiven for looking at the scene and seeing no progress. However, academia is more slow-moving and conservative in some aspects than other places. This is not a bad thing; not everyone has to move fast and break things. But at academia's normal pace, things are going pretty fast.
These problems are not unique to science. Take any large group of humans, be it government, the military, a company, a set of companies: they will coalesce onto the use of a certain number of tools, and it will take a LOT of energy and work to switch tools. Getting an entire industry to switch tools is extremely hard, perhaps downright impossible, and I'm not sure if it can be done in the rather slow-moving world of academic science. It simply won't be possible to enact a huge change on the system with so much institutional momentum built up.
It seems to me the best solution is to make incremental changes toward a github like system, training new scientists in grad programs to have better practices. Maybe we can't get researchers to post their full data set for all the public, but perhaps it can be made available to non-competitors, those who researchers aren't actively competing with for the same grants. Maybe researchers can be required by journals to post the peer-review comments/responses, as well as the drafts of the article, alongside the article itself. Maybe we can have researchers posting extremely detailed code/methodological information alongside the article, without forcing them to give over the entire dataset to other researchers?
Finally, maybe the whole incentive structure of academic science needs to change: maybe articles/publishing metrics should be de-valued in favor of teaching skills, mentorship ability, and collaboration within and across disciplines?
Who says we need to convince them? How about we leave them behind? They are rentiers, gatekeeping society's access to publicly funded scientific knowledge. I can't think of a reason why society should allow this hostage situation to continue.
I'm not saying this to be dismissive - I'm strongly in favor of faculties organizing to unseat administrators from their privileged positions. It's baffling to me that bright minds on campuses complain at length about the state of higher education but seem oddly averse to doing anything about it.
As far as tracking incremental improvements over time goes, I think it'll be hard to do better than our current method of including references to papers. It's impossible to track ideas the same way tracking code works (which itself is limited for similar reasons).
It would be nice if you could reference papers in a way that immediately allowed you to access them. And the technology to do so is there, but has limited use if papers aren't freely accessible from the internet.
But, given that the system of papers with references is essentially a DAG, I imagine someone will attempt to 'solve' the problem with blockchains before you can say 'initial coin offering'.
Why? I recently wrote a paper on GitHub. I loved it.
When you have a paper deadline in two weeks and four authors are furiously hacking in edits left and right, Git is absolutely invaluable when writing a paper. I can't fathom how people handled merges of written text without a version control system.
Open development is a policy for these projects and part of the grant stipulations.
Of course, data sets are more closely guarded initially until the groups that created them can publish. After that, though, CERN /LHC has done a decent job of making data publicly available from my understanding (not as someone directly involved).
I would be interested to hear more from scientists involved in projects doing open science.
[1] https://elifesciences.org/labs/8de87c33/texture-an-open-scie...
http://www.gitxiv.com/page/about
> It needs to be combined with a mechanism for peer-review and publishing...
Maybe an "interpretation" mechanism, similar to the Distill[1] project is doing, can serve two purposes at once: review and digestion.
I also feel a bit weird about badging in science in general, since most of the most passionate people I know in science are intrinsically motivated enough that I could never really see them really concerning themselves with such carrots unless it meant that they'd get more funds to do more of what they find fun.