4

I have been appointed to take part in reviewing papers for a conference. At the beginning I received an email in which the program chair told me to mark my fields of expertise, so I did that.

After a few days, it appeared in the reviewing page a list of all the papers submitted. But when they assigned me the papers, they do not assign me those in which I have expertise in the field and that I put in a previous email.

So now I have reviewed my assigned papers. I have seen that I can see all the papers submitted and there is also the possibility to put my review in those that there have not been assigned to me. Should I do that with the papers that are my field of expertise? or should I only review those that I have been assigned.

Thanks

3
  • 1
    This sounds like a pretty specific question. Personally, I would just email the conference chair and ask him this question directly; his answer will be more definitive than anything you get here.
    – eykanal
    Commented Jul 16, 2013 at 16:40
  • 3
    @eykanal: It is actually quite common in my experience. Commented Jul 16, 2013 at 18:01
  • @DaveClarke - See, this is why mods always have to wait before casting close votes :)
    – eykanal
    Commented Jul 16, 2013 at 19:49

1 Answer 1

11

Welcome to conference reviewing. Your situation is unfortunately extremely common. If the number of submissions in area X is less than the number of reviewers with interest and expertise in area X, then inevitably some of those reviewers will be assigned papers in area Y. Symmetrically, if the number of submissions in X is more than the number of experts in X, then some of those papers must be assigned to reviewers who'd prefer Z. Ideally, most papers are reviewed by experts and each reviewer is assigned mostly papers in their areas of expertise, but sometimes the matching system breaks down.

By default, you must review the papers that you were assigned. But there are a couple of ways to address mismatches.

  • If your assignment looks like a complete mismatch, you should quickly contact the PC chair and express your concerns, and in particular to verify that they received your preference email. If you're early enough in the process, the chair may be able and willing to swap assignments with other reviewers with complementary mismatches. There might also be a mechanism to swap assignments directly with other committee members, but you should always get the PC chair's permission before actually swapping.

  • Most computer science conference review forms ask for your confidence in your review; fill in this field honestly. If you really don't have the expertise to understand the paper or make a recommendation, your review should read "I apparently do not have the expertise to understand this paper or make a recommendation." That's a damning review of both the paper and the assignment process, but that's okay; your job as a reviewer is to be respectful but brutally honest.

On the other hand, as a matter of simple self-preservation, you should not review papers that you were not assigned. Reviewing well is extremely hard and time-consuming, and you have many other demands on your time. (And reviewing badly should just not be done at all.) Generally speaking, doing extra unsolicited reviewing will not earn you additional credit or brownie points.

There are a few exceptions. If you see a paper that you plan to read in detail anyway, despite getting no credit for doing so, you might as well write a review. And if the initial reviews of a paper disagree, the PC chair may seek out additional input or even full reviews; if you're asked about a paper in your area of expertise late in the review cycle, you should help. (If you're asked about a paper outside your area of expertise in later rounds, you should just say no.)

2
  • Your advice about when not to review is very sensible. I wish I heard it earlier. I have on multiple occasions reviewed multiple papers I was not assigned. This has been beneficial for me to obtain a broad view of the field when I was a PhD student. I have also done this for sub-areas that I felt needed better representation but had few expert reviewers. I'm not sure if that was stupid, but I felt the need to support an area.
    – Vijay D
    Commented Jul 18, 2013 at 1:38
  • That advice was specifically aimed at the OP, who has complained in other questions about lack of time and support for research. Of course you should read papers that aren't assigned to you.
    – JeffE
    Commented Jul 18, 2013 at 2:52

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .