I suppose I'm not the first person who came across this idea. I would like to compare math branches by means of numbers of articles published. I have access to two large math article indices: AMS' MathSciNet and arXiv.

My question is: Is it possible (in either of them) to get the information how many articles were published with a given MSC class, year by year?

  • For the arxiv, all it takes is some facility with scripting and web scraping. the data is all there. – Suresh Apr 8 '14 at 18:12
  • @Suresh I know it is there, but it's rather difficult to retrieve it, moreover, officially frowned upon by arXiv if I understood things correctly :-/ – yo' Apr 8 '14 at 19:36
  • 1
    really ? they provide the stats themselves (on a per-year basis aggregated across subjects). And I doubt they'd object to a slow web crawl over the year-by-year pages (after which you can parse locally). In particular, they have an explicit policy on how to access article meta data (which is all you need): arxiv.org/help/oa/index – Suresh Apr 8 '14 at 19:46

If you use R, you can use this script I wrote for scraping ArXiv metadata.

| improve this answer | |

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.