24

A bit of an odd question, but I would like to search for a phrase in articles from Science (the journal). Yet I cannot do this on Google Scholar--if I specify in the advanced search that the source is Science or "Science," I get results from all sorts of journals with the word "Science" in them. "Science Magazine" or any further specification yields zero search results. Furthermore, Science Magazine's website search is terrible, and returns every article in the issue of an article containing a search term (my search is for "hierarchical model").

Has anyone else run into this? Can anyone think of a search term trick that might help?

1
  • Most journal websites have a search feature to search for articles.
    – Kevin T
    Nov 14, 2018 at 21:55

7 Answers 7

12

The site: qualifier can specify results from a particular URL.

In this case, searching "hierarchical model" site:sciencemag.org in either Google or Google Scholar seems to work.

3
  • 9
    site: is not the same as searching within a specific journal, site: is used to search within a domain. Jan 14, 2018 at 10:49
  • 4
    @HermanToothroth Right; it's a hack to get around the problem. Specifically, they're already trying source:Science and source:"Science", but this seems to include references to papers in journals that have "science" in their title as opposed to just articles from the journal Science.
    – Nat
    Jan 14, 2018 at 16:03
  • 2
    That's it right there, thanks a bunch. Now that I know what to look for, here's a list of search tips I found that includes the "site" keyword: wur.nl/en/article/Google-Scholar-13-search-tips.htm Jan 15, 2018 at 3:46
14

Like Google, Google Scholar seems to support boolean operators. So one way to solve the problem would be to use "-source:[string]" (note the minus sign) to exclude by hand journals with names containing "[string]". This may take a few iterations of trial and error before you get only the results you want, and can of course also be used in conjunction with the "site:" qualifier to narrow things down further. E.g.

coffee source:"physical review" -source:"physical review letters"

Generally speaking, boolean searching is a powerful technique, and one that a lot of people seem to be unaware of.

7

You have to use source: followed by the name of the journal

For example, source:nature if you want to search in Nature

1
  • 3
    This is correct, though it's the same thing that they're already doing. This is, if you try to use Google Scholar's Advanced Search feature, then search for content from "Science", it'll convert it into with with the qualifier source:Science. The problem presented in the question is that this returns hits from sources that have "Science" in their name rather than just the actual journal called "Science".
    – Nat
    Jan 14, 2018 at 16:06
1

Alternatively, you could use a big university catalog online search feature for this rather than Google Scholar. Note, you don't need to be affiliated with the institution to do a catalog search. The affiliation will only be required for the second step, pulling up article contents.

1

You could use a different academic search engine. All Science articles are indexed in MEDLINE, so you could use the following search to find "hierarchical model" in Science articles. It returns 8 results. It will find instances of this phrase in the article abstract, title, or full text, if the article is freely available.

0

Google Scholar - Advanced Search allows you to specify the name of the publication (put the name in quote marks to prevent the words being applied as if joined with AND).

1
  • 2
    This doesn't solve OP's problem, because it won't exclude longer journal names containing the journal name you specify. If you try to use this method to restrict results to e.g. "nature" you'll find plenty of search results from journals like "nature physics". Also see Nat's comment to Herman Toothrot's answer.
    – Anyon
    Nov 15, 2018 at 19:28
0

If you want to extract those papers programmatically, for example via Python, you can do it using Google Scholar Organic Results API from SerpApi, which is a paid API with a free plan of 100 searches to test out. Check out the playground.


Code and example in the online IDE (you have to pass your SerpApi API key in order to work):

enter image description here

# https://academia.stackexchange.com/questions/102122/how-to-search-for-articles-from-a-specific-journal-in-google-scholar-when-the-jo

import os, json
from serpapi import GoogleSearch
from urllib.parse import urlsplit, parse_qsl

params = {
    # os.getenv(): https://docs.python.org/3/library/os.html#os.getenv
    "api_key": os.getenv("API_KEY"),                 # your Serpapi API key
    "engine": "google_scholar",                      # search engine
    "q": '"hierarchical model" site:sciencemag.org', # search query
    "hl": "en",                                      # language
    # "as_ylo": "2017",                              # from 2017
    # "as_yhi": "2021",                              # to 2021
    "start": "0"                                     # first page
}

search = GoogleSearch(params)         # where data extraction happens

organic_results_data = []

papers_is_present = True
while papers_is_present:
    results = search.get_dict()      # JSON -> Python dictionary

    for publication in results["organic_results"]:
        organic_results_data.append({
            "page_number": results.get("serpapi_pagination", {}).get("current"),
            "result_type": publication.get("type"),
            "title": publication.get("title"),
            "link": publication.get("link"),
            "result_id": publication.get("result_id"),
            "summary": publication.get("publication_info").get("summary"),
            "snippet": publication.get("snippet"),
            })

        if "next" in results.get("serpapi_pagination", {}):
            search.params_dict.update(dict(parse_qsl(urlsplit(results["serpapi_pagination"]["next"]).query)))
        else:
            papers_is_present = False

print(json.dumps(organic_results_data, indent=2, ensure_ascii=False))

Outputs data from the one page as there's no pages for such search query:

[
  {
    "page_number": null,
    "result_type": "Pdf",
    "title": "Hierarchical Network with Label Embedding for Contextual Emotion Recognition",
    "link": "https://downloads.spj.sciencemag.org/research/2021/3067943.pdf",
    "result_id": "vuRtqci4UKYJ",
    "summary": "J Deng, F Ren - Research, 2021 - downloads.spj.sciencemag.org",
    "snippet": "… In this paper, a hierarchical model with label embedding is … This paper explores a hierarchical model to learn contextual … (1) This paper proposes a hierarchical model to learn contextual …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Toroidal Magnetic Fields for Stable Plasma Confinement",
    "link": "https://science.sciencemag.org/content/160/3826/439.3.extract",
    "result_id": "kqZ_vhnt8KUJ",
    "summary": "DW Kerst - Science, 1968 - science.sciencemag.org",
    "snippet": "… The results of these studies are interpreted in terms of a hierarchical model of mental abilities going from associative learning to conceptual thinking, in which the development of lower …"
  },
  {
    "page_number": null,
    "result_type": "Pdf",
    "title": "A high-throughput phenotyping pipeline for image processing and functional growth curve analysis",
    "link": "https://downloads.spj.sciencemag.org/plantphenomics/2020/7481687.pdf",
    "result_id": "093PpcXeoM8J",
    "summary": "R Wang, Y Qiu, Y Zhou, Z Liang… - Plant …, 2020 - downloads.spj.sciencemag.org",
    "snippet": "… The hidden Markov random field (HMRF) model is a hierarchical model with an unobserved layer for the pixel class and an observed layer for the pixel intensity given its class. The …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Galactic Blowup",
    "link": "https://science.sciencemag.org/content/326/5950/206.2.abstract",
    "result_id": "WQd-NjqsznsJ",
    "summary": "M Cruz - Science, 2009 - science.sciencemag.org",
    "snippet": "… Fritz et al. show that a hierarchical model can be used to calculate the diffusion coefficients and excess chemical potentials (solubilities) for ethylbenzene diffusion in atactic polystyrene …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Microwave-Safe Dishes",
    "link": "https://science.sciencemag.org/content/326/5950/206.3.abstract",
    "result_id": "k-jOiH7l3-8J",
    "summary": "J Yeston - Science, 2009 - science.sciencemag.org",
    "snippet": "… Fritz et al. show that a hierarchical model can be used to calculate the diffusion coefficients and excess chemical potentials (solubilities) for ethylbenzene diffusion in atactic polystyrene …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Dissolute Behavior Up North",
    "link": "https://science.sciencemag.org/content/326/5950/206.1.abstract",
    "result_id": "5FXzkE1KrfUJ",
    "summary": "C Ash - Science, 2009 - science.sciencemag.org",
    "snippet": "… Fritz et al. show that a hierarchical model can be used to calculate the diffusion coefficients and excess chemical potentials (solubilities) for ethylbenzene diffusion in atactic polystyrene …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Embedded Sensors",
    "link": "https://science.sciencemag.org/content/326/5950/207.1.abstract",
    "result_id": "uJ2gwtehXzgJ",
    "summary": "LD Chong - Science, 2009 - science.sciencemag.org",
    "snippet": "… Fritz et al. show that a hierarchical model can be used to calculate the diffusion coefficients and excess chemical potentials (solubilities) for ethylbenzene diffusion in atactic polystyrene …"
  },
  {
    "page_number": null,
    "result_type": "Citation",
    "title": "Pregnancy Can Be Stressful",
    "link": "https://science.sciencemag.org/content/326/5950/206.4.abstract",
    "result_id": "f6-h2PtpV_gJ",
    "summary": "BA Purnell - Science, 2009 - science.sciencemag.org",
    "snippet": "… Fritz et al. show that a hierarchical model can be used to calculate the diffusion coefficients and excess chemical potentials (solubilities) for ethylbenzene diffusion in atactic polystyrene …"
  },
  {
    "page_number": null,
    "result_type": "Pdf",
    "title": "Recent advancements in optical harmonic generation microscopy: Applications and perspectives",
    "link": "https://downloads.spj.sciencemag.org/bmef/2021/3973857.pdf",
    "result_id": "xHvS7epGUmsJ",
    "summary": "DS James, PJ Campagnola - BME Frontiers, 2021 - downloads.spj.sciencemag.org",
    "snippet": "Second harmonic generation (SHG) and third harmonic generation (THG) microscopies have emerged as powerful imaging modalities to examine structural properties of a wide range …"
  }
]

Disclaimer, I work for SerpApi.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .