I'm looking to do an extensive literature search.
I would like to start with about half a dozen or so survey papers in the field, and look at their bibliography. Then, I would like to go through each of those papers and look at their bibliography.
This can continue until I have, say, 500 - 1000 papers in a a relationship graph, after I've pruned papers that do not contain certain keywords or words in their title/abstract. Then, I can rank the papers based on their connectedness in the graph, weighted by the age of the publication.
Sounds great, but I can't see any easy way to accomplish this. I've looked at DBLP and crossref.org, but neither of these show the bibliography of the papers. Web of Science has an API to which I may be able to get access, but I don't think that will provide bibliography either.
Short of manual web scraping, is there any way to achieve this?
I can't scrape Google Scholar since it doesn't show the bibliography of papers, but Microsoft Academic Search does. MSAS does have an API, but you need to apply with information like Project URL to get access, which is not applicable in my case.