6

I'm wondering if it is possible to download all articles from references in a pdf file or on a journal website. For example I'd like to download all articles in the following references (I'm using the internet connection of my university, thus I can download all articles if they were purchased; I suppose my university did it):

https://www.hindawi.com/journals/isrn/2012/170594/ref/

Thank you for your help.

Ps: I have also the pdf file of the article.

closed as off-topic by Buzz, Bob Brown, scaaahu, user3209815, user2390246 Oct 24 '17 at 13:31

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • ""Shopping" questions, which seek recommendations or lists of individual universities, academic programs, publishers, journals, research topics or similar as an answer or seek an assessment or comparison of such, are off-topic here. (See this discussion for more information.)" – Buzz, Bob Brown, scaaahu, user3209815, user2390246
If this question can be reworded to fit the rules in the help center, please edit the question.

3

As far as I know, there is no automated service to do this. One of the reasons is that mass download of research papers is frowned upon by the publishers (look up the sad story of Aaron Swartz, for instance).

If you want to build an automated (or semi-automated) solution yourself, one of the trickiest steps is identifying correctly the cited papers from the citation strings. For this you can use a research paper database, such as Scopus, Web of Science, or Pubmed. For instance, Scopus displays the references of a given paper in its page, and for each paper you get a "view at publisher" link that redirects you to the article page on the publisher website. This web page usually has a "download pdf" link inside it (usually paywalled, too), and since most papers come from the same major publishers it is should be possible to scrape this link automatically at least for these publishers.

Unfortunately the paper that you link to does not seem to be indexed neither in Scopus nor in Web of Science --- maybe because Hindawi is not one of these most "mainstream" publishers. It is in Pubmed, though. I am less familiar with it, but if you click on the references you also get a page with a "full text" link in it.

Note that Google Scholar does not display "forward" citation information, instead; only the reverse (papers citing a certain paper).

As mentioned in the other answers, you may be violating some terms of service if you do so. Terms of service are not the law, though, and I think you can only get into a very limited amount of trouble for that.

A Google search returns a few tools to do similar things:

I do not have experience with any of them, though, and I don't know if they are mature/stable enough for casual use.

2

What you are thinking of is a web-scraper. The time it takes to develop one and debug it should be weighed against the cost of directly downloading the PDF's manually.

If you don't have experience with python (a popular language) or R (which I am familiar with) I would recommend the old fashioned way (manual download)

With the comment by AJK, read VERY CLOSELY your Terms of Service, to see if you can use a scraper.

  • 2
    Also, many journals have policies specifically prohibiting systematic scraping, and will block users who do it or put up barriers to prevent it. While downloading 30-100 references probably won't raise any flags, there are issues at larger scale. [This is not to say it's a bad idea or even unethical - I've often wanted to do something like this!] – AJK Oct 24 '17 at 0:53
  • As someone who manually downloaded 300+ articles.... sigh – Frank FYC Oct 24 '17 at 0:55
0

A easy way to do this is with a Firefox add-on called Down Them All: https://addons.mozilla.org/en-US/firefox/addon/downthemall/

Screenshots: enter image description here

enter image description here

In this second screenshot, notice that you can specify where the downloaded files should go; and you can specify what types of files should be downloaded. Please note that this tool works with pages that have a bunch of linked PDFs you want to download efficiently -- which is apparently not your situation right now.

  • Hi @aparente001, I have Down Them All, but it does not show the pdf articles on the above link because the webpage hasn't direct link to pdf articles. Maybe I was missing something? – Gennaro Arguzzi Oct 24 '17 at 6:57
  • Sorry, Gennaro, I hadn't understood there were no links provided. You might be able to be more efficient by using a URLOpener Productivity Tool in an intermediate step. Also Federico's idea looks promising. – aparente001 Oct 24 '17 at 18:57
  • 1
    Hello @aparente001, I'm dolt with this tool. If possible can you post a short video tutorial please? – Gennaro Arguzzi Oct 25 '17 at 6:45

Not the answer you're looking for? Browse other questions tagged or ask your own question.