3

There are many, many websites that include a search function that returns a list of papers matching some keyword: Scirate, Shortscience, Brevy, etc.

Do all these sites run their own crawlers and build up their own index? Or is there a shared index somewhere?

For example, if you go to shortscience.org/search, and type in 'computer vision' it comes up with a list of relevant papers. Where is this data coming from?

Improve this question
4
  • Ssrn.com is an open database, but generally these papers have yet to be peer reviewed.
    – Dave Harris
    Jan 11, 2017 at 4:03
  • Scirate is based on arXiv.
    – Tobias Kildetoft
    Jan 11, 2017 at 7:28
  • 4
    Of the services that you have listed, only Google Scholar indexes papers. The other services support various "extras" involving academic papers, but aren't really intended as an index. Can you clarify what you're asking, and why this information would be useful to you? It might help us give you a better answer.
    – ff524
    Jan 11, 2017 at 8:16
  • For example, if you go to shortscience.org/search, and type in 'computer vision' it comes up with a list of relevant papers. Where is this data coming from?
    – Anta Res
    Jan 11, 2017 at 8:51

1 Answer 1

Reset to default
3

There are various APIs that other services can use to search assorted indices from other sites

For example, according to the about page of ShortScience.org:

The search can access all papers in the DOI, arχiv, dblp, and Bibsonomy databases

Some of those (e.g. DBLP) only host bibliographic data; others (e.g. arXiv) host the full text of articles or preprints. Some allow access to their data by API, others make their complete database available for download.

SciRate uses arXiv. Brevy does not seem to have an index; it's just a wiki, and the search function just searches user-submitted content.

Improve this answer

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .