Hacker News Reader

Comment by stephentmcm | Hacker News Reader

So how long until someone writes a web crawler that dumps all the links into a searchable public db?

This has already been done many times with regular pdfs [1-3]. There are mostly hosted illegally in places like Russia. I'm sure you can find more on TPB or similar.

[1] http://sci-hub.org/ [2] http://booksc.org/ [3] http://www.freefullpdf.com/

Unfortunately, these don't host many of the articles I would love to have access to. If I didn't know anyone still in uni, I would probably have no way of doing good research. Looks like one of them is proxying through a university that has access though.

You can also try /r/scholar; you usually get responses within a day or so [1].

[1]. http://www.reddit.com/r/scholar

sci-hub never let me down. It may take a while but it's quite effective.

How much is a subscription?

The data needed for searching (titles, abstracts, and other metadata), at least for biology-related articles, is already available in an XML dump from NIH. The public interface is called PubMed, so you can already search for Nature articles, just not within full text.

I have actually tried to do what you are suggesting before, so I could bulk-download PDFs (I have an institutional subscription). The problem is that the URLs are different for every journal, and some have Javascript that makes automated downloading hard. Since there are thousands of journals, it's very tedious to try to invent a generalized solution.

The public link is probably coded to each subscriber, so they would be able to identify the culprit and disable all the links from that subscriber.

Hah, come on. :) That's not a very high barrier. A 'pirate' simply has to get a throwaway account (or steal one, if he's truly bad) and he doesn't even have to worry about that.

I expect all Nature articles made "free" today to be available on TPB in one month. I'll put .1 BTC on it. :)

What odds?

As soon as a link is shared, each person who learns the URL is potentially a "culprit."

Not if the URL encodes the originator of the link, and all links tied to that user stop working when Nature flips a switch.

But regardless of what DRM scheme they choose, it's doomed to fail, all it takes is one person to crack the scheme and liberate the underlying documents. Alternatively, since 100 anointed blogs and media outlets will apparently have the right to download raw PDFs, all it takes is for one of their accounts to get hacked.

Don't you have that problem already?

Reply on news.ycombinator.com