59

Is there an easy way or existing tool to generate a historical chart with the occurrence of one or more user-specified keyword(s) (combinations) in academic publications, based on the words in the title and/or abstract of a paper?

There is a almost-what-I-was-looking-for tool called Google Scholar Trend Miner, but it seems to be not working anymore, as it reports after hitting Go: "It seems that Google found out that we are a bot and started offering its CAPTCHA. Please, wait some hours and try again"

1
33

If you have access to it, you can very easily do that with Thomson Reuters’ Web of Science portal. Run any query you want, probably starting with the simplest one: Topic=XXXX. Then, select “Analyze results” at the top-right bottom-left of the results list, and sort them by year of publication:

enter image description here

2
  • Great. I couldn't find the "Analyze results" link immediately. Seems it only appears with the "Web of Science" tab selected and not for "All databases" Sep 26 '12 at 12:53
  • @Rabarberski some of the functionality is avaible only from the "Web of Science" tab, indeed… I've never really understood why.
    – F'x
    Sep 26 '12 at 13:01
14

I've written a small Python tool for this purpose. It scrapes Google scholar for each year in a given time span, extracts the occurrences and saves them to a CSV file. The tool is located at: https://github.com/Pold87/academic-keyword-occurrence

14

Edit: I though I would update this answer with a tool I recently discovered--trends.google.com

It's not specific to peer-reviewed publications, but allows one to search keywords by country, category (e.g., science), and web/image/news/.

enter image description here

Google's Ngram viewer is also useful. It's quick and easy for seeing trends as far back as the 1800's.

enter image description here

4
  • 3
    Is there a way to restrict n-gram viewer to academic publications? Feb 17 '16 at 6:45
  • 1
    @FedericoPoloni I don't believe there is; the only corpuses they offer are specific-language or "Fiction"
    – Andrew
    Feb 17 '16 at 15:27
  • See Pold's answer below.
    – Derelict
    Feb 17 '16 at 15:29
  • google trend is about what peoples search on google. This tools as nothings to do with publication.
    – gagarine
    May 12 '19 at 22:08
6

You can have a look at the arXiv cultoromics website at http://arxiv.culturomics.org, which however searches in articles on the arXiv. Depending on your field of interest, this may or may not be good enough.

3

Web of Science is a great resource for a historical review or a trend analysis of a keyword or subject. Another resource is Scopus. To use Scopus to search for a review of a phrase, word, or keyword from a controlled vocabulary keyword such as MeSH or EMTREE, enter the phrase, word or keyword in the search box and select the appropriate search filter to the right of the search box. You can search by title, abstract, keyword, or any combination of the three. Results can be filtered by a number of options and also can be exported for further analysis. The caveat to databases such as Web of Science or Scopus is to check the date range of the materials indexed.

3

Scholar Plotr doesn't work anymore due to rate limiting by Google. An alternative easy to use and free tool for anyone without academic licences is Dimensions AI:

app.dimensions.ai

It works with it's own publications database and shows a lot of statistics e.g. publications per year, citations per year.

5
  • I wouldn't say GooSchol only shows academic research.
    – Kimball
    Aug 8 '17 at 13:52
  • according to themselves they do: "Google Scholar includes journal and conference papers, theses and dissertations, academic books, pre-prints, abstracts, technical reports and other scholarly literature from all broad areas of research. You'll find works from a wide variety of academic publishers, professional societies and university repositories, as well as scholarly articles available anywhere across the web. Google Scholar also includes court opinions and patents." from google scholar
    – very
    Aug 9 '17 at 7:58
  • but of course something might slip in there, that isn't of a certain standard.
    – very
    Aug 9 '17 at 8:05
  • 2
    I just meant that not all academic books and scholarly literature counts under research. For instance, some course notes I've written are indexed by Google Scholar. While they're certainly academic, most of them are not research level.
    – Kimball
    Aug 9 '17 at 8:59
  • 1
    Now they recommend app.dimensions.ai/discover/publication on the top of the their webpage, since their site doesn't work reliably any more.
    – Armut
    Oct 11 at 22:37

Not the answer you're looking for? Browse other questions tagged or ask your own question.