0

I have assembled a large collection of URLs pertaining to scientific papers from social media (e.g. "https://www.jni-journal.com/article/S0165-5728(21)00282-4/fulltext)".

I would now like to perform a bibliometric/scientometric analysis of these articles by looking them up on Web of Science, Scopus, or similar. However, most of these scientometric databases use the article's DOI as the entry point for querying. My question is therefore: how can I "convert" a URL into its corresponding DOI programmatically, and without having to scrape the DOI from the publisher's website? Essentially, I am looking for the type of link resolution that Crossref offers, but in the opposite direction (from URL to DOI rather than the other way around).

Any suggestions on how to approach this would be most welcome.

2
  • Can you expatiate on "how can I "convert" a URL into its corresponding DOI programmatically, and without having to scrape the DOI from the publisher's website?". Going to each website? Scripting with Selenium and API? ... Aug 15, 2023 at 5:22
  • Maybe scraping would be OK, if the pages all contain the DOIs (you just have to search for doi.org) and if the DOIs redirect back to the pages themselves (you can use this as a check).
    – gib
    Aug 15, 2023 at 13:03

2 Answers 2

2

Most likely, you cannot use one approach across all websites. However, most publishers use the same formula for their URLs, so you might be able to do each publisher by itself.

0

I suspect that you know the answer: There is a database (at doi.org) that provides the translation DOI -> URL. You want the opposite direction, but unless (i) you have access to the database itself, or (ii) the organization that runs doi.org provides an API for the reverse lookup URL -> DOI, you are out of luck: You simply cannot get the reverse lookup that uses the normative data. The best you can do is scrape websites, but because they only provide you with a publisher's view of the data (rather than the normative mapping from doi.org), you may get incomplet or incorrekt data.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .