Sci-Hub users cost ASA journals thousands of downloads
familyinequality.wordpress.com
familyinequality.wordpress.com
https://www.reddit.com/r/DataHoarder/comments/ed9byj/library...
All of the documents accessed through sci-hub are archived by the library genesis project and made available as torrents. Currently there are just over 80 million articles included in these torrents. The total size of the archive is around 70TB. The link above also refers to the library genesis books collection, which is 33TB.
This effort has seen tremendous interest in recent weeks; the books collection (libgen) is now widely replicated, but around a third of the scimag articles collection (i.e. those from sci-hub) has only 1-2 reliable seeders and needs more before it can be considered safely backed up. If you have the resources available, I would encourage you to consider assisting. Previous discussion of this project is at https://news.ycombinator.com/item?id=21692222
Looking forward, the next step is to find a suitable way of providing accessible, truly decentralized access, without relying on a single point of failure (i.e. a web interface). Some have been exploring IPFS as a potential mechanism, but there are many ways this could be done. This is a challenging but important problem to solve; with the data available, there is now an opportunity for developers to address the access issues. There may come a day when the sci-hub website goes offline, and it would be good if a fallback is already in place at that point.
Aaron Swartz may no longer be with us, but his spirit lives on. It's now up to us to carry on the fight for which he paid so dearly.
> Some have been exploring IPFS as a potential mechanism
IPFS has no anonymity, so individual nodes could be attacked the way individual torrenters got sued back in the day.
> but there are many ways this could be done
There are currently no scalable ways this could be done. If there were you wouldn't have a single bold researcher providing a single point of failure search engine that hops to some other location each time authorities shut it down.
If you believe in the importance of science, and if you're a software engineer at FAAAANG, then you can afford a 75+45 TB (scihub+libgen) hard drive array. If you are making $300,000/year then a $5-10k hobby project to store distilled human progress is something that you could make financially possible for yourself.
Consider doing this, because this might be the last opportunity to get a relatively complete copy. Just having a copy and letting it sit for 10 or 20 years can be hugely valuable to the world, let alone your community.
A quick ebay search right now shows used LTO8 drive for $3K (same as new), LTO7 for $1.8K, LTO6 for $0.5K, LTO5 for $0.15K. If you shop around, you can find much better deals.
Here are some tape costs:
LTO-5 (1.5TB/$19.60 = $13.07/TB) LTO-6(2.5TB/$22.58=$9.03/TB) LTO-7 (6TB/$57.95=$9.66/TB) LTO-7 type M (9TB/$57.95=$6.44/TB) LTO-8 (12TB/$134.25=$11.19/TB)
Breakevens:
LTO8=300T
LTO7=300T
LTO6=75T
LTO5=50T
LTO4 and below=never
Of course without a tape robot, no one should be using LTO5--there's some personal inconvenience cutoff for everyone.Check it out, contributions welcome. https://github.com/frrad/skyhub
I'd love to seed. I even have the space for quite a lot but seeding illegal content in Germany is a big nono.
the content isn't illegal, the act of copying it might be
Has anyone proposed naming an "information making free" service after him yet?
Then there's Star Wars, Swartz always being you you, and such (a joke made with Jonathan Schwartz as well). I quite like that saying, but it may be considered cheap/offending by some.
Publishers don't prey on individual users, they prey on universities. They try to get them to pay for journal access. Non-academic clients? Not profitable enough for us, go away. Scihub threatens this business model, because universities may decide to stop paying that money because Scihub exists. It's much more convenient than bothering a random person to provide you a paper or inter-library loan which makes this an actual risk to them.
Without a Sci-Hub-like option, the political pressure on government (and likely: university) archives to not provide free-to-the-public services will likely continue. Only the continued persistence of a truly free option, in flagrant violation of an unjust and immoral legal environment, can break down that wall.
Unfortunately, this dynamic is more social than anything: there can only be so many aggregators that can occupy the zeitgeist. That scarcity of attention leads to rent-seeking behavior, which is the main problem with academic journals. The current situation is probably approaching optimal; large institutions fund the moderation and aggregation through journal subscriptions, while access is widely available via Sci-Hub.
Without a profit motive, such moderation would be even more politically-driven than it is today. At the same time, the Sci-Hub community does need to ensure its continued existence because it is such a massive boon to science writ large.
Those offering a paid services should always ensure there is a benefit and convenience compared to piracy. Valve and Steam wouldn't be here if it was clumsy like in the beginning. Gamers like that getting a game is just a click away, that it installs and checks all the required dependencies, keeps the game file updated, allows you to preload and keep your game saves in the cloud (when possible).
At the end of the day when considering the behavior of large numbers of heterogeneous users, UX is king for all data consumption. The pricepoint matters, but people would use SciHub even if traditional journals somehow moved to free publication... If the UX is better for SciHub.
This type of semi-automation would be very impractical and cost an order of magnitude more time if I had to dig through the probably non-existent API documentation individual publishers have, or try and scrape their I'm sure by now heavily obfuscated websites.
It's also not like there was no piracy before scihub showed up. When I encountered a paper I didn't have access to back in the day, I would ping all of my friends at various universities / companies / hospitals and request that they check if they had access. If so, I would ask that they download it and send it to me. They would do the same when appropriate. Even doing this was more efficient than going through official channels, and every time this was done it represents another lost sale. From a user perspective, the piracy has nothing to do with money and is instead entirely about friction.
At MIT, a few years after the arrest of Aaron Swartz, a prominent researcher from Mass General Hospital was threatened one afternoon with arrest by an MIT police officer for the alleged "crime" of using one of the library computer terminals for "longer than an hour."
It's worth remembering then that there are some out there who are using SciHub now because they don't want to go to jail for trying to access the same content through more "legally legit" channels.
This may sound tinfoil hattish, but ever since I was in school i've believed it's to keep knowledge out of the hands of the poor. Accessing journals is basically out of the question for ordinary people, unless they go to a university library, or spend money they're not going to spend, almost all reporting on science is complete and utter garbage that at best, gets most of the facts wrong, at worst misrepresents or distorts the article being reported on completely.
I don't like making blanket statements, but i've noticed, many people lack even basic knowledge of scientific methodology and almost see it as a black voodoo magic or something. Average people have no real way to verify scientific claims made by media even if they wanted to.
I have to be honest too, going through school, this attitude was prevalent among my teachers, that scientific knowlege was best left to scientists to interpret for average people. Everything around science has a 'it's our special club' thing going on designed to trickle only what information scientists and authorities deem necessary.
Hell, the data from my own project was locked away by the government behind a paywall, despite it being funded by tax money under the stipulation in our grant that our results and data would all be made publically accessible and we were only studying small mammals.
Science, especially publically funded science, should be available for everyone. I've never agreed with the idea of hidden knowledge. Human progress comes from humans learning and sharing knowledge with eachother. Keeping knowledge locked up for a special elite cripples the progress of humanity.
That said, I get the concern that non-scientists can often misrepresent scientific findings. I read the other day that apparently lemon peels are 10,000 times more effective than chemotherapy at treating cancer for example. But I don't think the solution is to lock away knowledge. The solution should be to try to educate people as much as possible.
Yeah...me too...I'm guessing people didnt actually read what I wrote...
Sci-hub means I can read the latest science about my disability without $40 paywalls on top of a mediocre paper which give eye-poppingly low margins to the actual authors. Papers which ironically often discuss how society makes disability a problem by throwing unnessecary barriers in front of the disabled. That yarn on about how the disabled lack autonomy over their own healthcare.
Scihub is in a legal grey area (not really legal, so I can't technically advocate for its use in my position), but in a way it's automating the normal process of asking researchers for a copy of the paper, thus saving the researchers' time. (Researchgate is a more legal version of this, but with much less access to papers.)
Not just if it's open access: sometimes authors have to pay "page charges" or have to pay extra to include illustrations.
You mean exactly 0? Authors are almost never paid to publish in a journal.
The writer has to constatly remind me that running the proxy is a crime, but using it - even if she knows that it's not the legitimate way to get the information- is not.
This may be true, still I don't like the tone, as clearly sci-hub is providing the huge value to people, not her.
I wouldn't be surprised if some life saving drugs would be developed and used in practice faster because of sci-hub.
This could very well be false: without sci-hub, people might instead use arxiv and the like; perhaps sci-hub brings journals thousands of downloads they would not have if sci-hub didn't exist.
As I don't use it I can't say if this might be accurate, though.
Sci-Hub doesn't give me information for free I'd otherwise have to pay for - rather it provides information I'd otherwise have little access to.
There was that study in EU that said piracy actually helped the game industry.
There is also what the author was commenting, sci-hub is easier to use than the legal alternative. We go tour researchers stuck in bureaucracies, to access papers funded by taxpayers! As Gabe Newel said, to fight piracy, you provide a better service (Steam was the biggest hit to game piracy, and so was Netflix for series and movies), instead of that, what we see is more control/bureaucracy being added.
edit: https://www.engadget.com/2017/09/22/eu-suppressed-study-pira... it's an old study (2013), but I doubt the situation got worse. In videogame land the greatest example is The Witcher 3, easiest game to pirate, has it was distributed without DRM, you could just copy your friends installer. It was still on the top of steam most played single player game(which requires the key to be unique), won a lot of awards, and got so much exposure that netflix has released a TV show...
Steam beats video game piracy because video game piracy requires shit like having a torrent client or having a friend who has a copy already. Video game piracy was never as easy as sci-hub.
I'm not a researcher, but download lots of articles just as general curiousity. I definitely wouldn't have $30 for each download, as I'm not profiting of it at all.
I use sci-hub - others can decide for themselves to use it - but I'm not going to say others should think it is okay or not okay if I use it - the value judgements of most other people regarding my actions is not something that I care about a lot.
Seems like it'd be difficult to precisely estimate the effect of open literature on advancing education, research, and development efforts.
Back when I was a student, we had access to a lot of journals -- but not all of them. And to use them, we had to connect through a laggy VPN to the university, as we often traveled; sometimes it was down. And then when we worked with industrial partners, we couldn't just email them relevant papers as that'd have been illegal. And we couldn't even just email each other papers, as I think the terms-of-use required us to independently download articles.
And, again, that was with university subscriptions! Rising students and professionals who go into industry typically can't access articles at all. Sure, if they really need a specific paper they can try to find a way, but that's a horribly inefficient way to do research; to be effective, a researcher really needs to be able to browse through the literature freely, reading lots of papers without being distracted by technical barriers.
Given that the current system slows down everyone, it's hurting all of us. All of science, technology, engineering, medicine, whatever -- it's all less than what it could've been because we're being held back.
But how do we quantify the on-going harm? How can we guess what sorts of inventions weren't made because researchers didn't have access or were fighting with a buggy VPN? How do we guess at how much education's being held back by students not knowing how to access the literature before college? What about all the damage from working professionals not being able to browse the literature related to their field?
Anyway, yeah, the article's constant references to Sci-Hub, as though it's somehow criminal, were definitely jarring. Sci-Hub feels like it should be legal based on the same sorts of arguments that make self-defense or providing emergency assistance legal.
Is there seriously anyone not employed by the giants (Elsevier, Bertelsmann et al) who opposes sci-hub?
It’s not enforced by police but if you’re doing science or engineering then the biggest employer in your field might be the government (DoD etc.) It’s not all that rare for people to get denied security clearances because of excessive piracy and that would make it way harder for you to be employed.
This is a huge part of the problem with having laws on the books that just aren’t always enforced.
He recently came out in opposition to the ASA's official stance rejecting a proposed federal mandate to make all publicly funded research available open access. The ASA joined other scholarly associations in opposition such a mandate.
The author recently discussed his stance on The Annex podcast: http://sociocast.org/podcast/the-paywall-and-the-asa/
I'm all for journals, I appreciate there's a cost to keep them going but large publishing aggregators who take your work for free and have the cheek to make you jump through hoops for the privilege deserve to collapse. The paradigm is old and broken.
Sarcasm aside, that title is waaaay loaded. It sort of insinuates sci-hub users are the burden and not the journals.
With all the people using Sci-Hub, I wonder if it is becoming possible to make legislation to either or both
* Declare Sci-Hub and its practices legal outright, and make it the new normal.
* Carve out extra protections for open access to science in general.
It's not exactly what you mention, but most Dutch researchers are legally allowed to freely share their work six months after publication: https://www.openaccess.nl/en/in-the-netherlands/you-share-we...
> Article 25fa of the Copyright Act (Taverne Amendment) allows researchers to share short scientific works (e.g. articles & book chapters), regardless of any restrictive publishers' guidelines.
> The maker of a short scientific work, the research for which has been paid for in whole or in part by Dutch public funds, shall be entitled to make that work available to the public for no consideration following a reasonable period of time after the work was first published, provided that clear reference is made to the source of the first publication of the work.
I'm not sure to what extent this helps, but it's at least possible to hyperlink to an individual page in a PDF.
I have never used these services at a University. Do they even require a login? Or do you get automatic access just from using a terminal on campus?
Seriously though our beloved AI doesn't have reliable object permanence yet. It can't read now and it certainly won't be reading research papers for a while. Be nice, give it some time to grow.