I want to find a way to bulk-download citation data on (ideally!) all the papers published in my particular academic discipline. I want to analyse this large corpus of data using AI text classification tools, because I want to identify all papers that fit in a certain category. At the very least I want the basic citation info (title, authors, year, journal), and abstracts would be nice to have as well.
Are there tools for scraping the contents of literature databases that could achieve this objective? For example, one approach might be to compile a list of all journals that are relevant in my field, and use that list to download citation data for every single article in each of those journals. Or perhaps downloading citations of all papers that have certain keyword (even if there are very very large numbers of results).