Questions tagged [peer-review]

On the evaluation of work (typically, a publication or grant proposal) by the author's peers. This includes: refereeing, which is often used to determine an academic paper's suitability for publication in a journal or conference; peer evaluation of teaching skills; peer review of research grant proposals; and post-publication review of a book or article, as is common in the field of mathematics.

Filter by
Sorted by
Tagged with
32
votes
2answers
2k views

What changes after peer review but prior to final submission are acceptable for a conference paper?

Suppose I write a paper and submit it to a conference. The paper gets some weak rejects and weak accepts and lots of criticism, but the conference is not that prestigious, so they accept it anyway. ...
32
votes
1answer
2k views

Studies over how noisy is it to accept/reject submissions

This year, the NIPS 2014 conference did an interesting experiment: conference chairs duplicated 10% of the submissions (170 papers) and sent them to two different groups of reviewers. The result: 25.9%...
31
votes
3answers
6k views

How can one's career as a reviewer be ended?

In this forum, I am reading this great question (What is required of a mathematics referee?) by a user with the name mathprofessor. There is an answer by a user with the name Buffy which starts with: ...
31
votes
7answers
2k views

What to do when a referee wants to criticize someone else through me

A couple of months ago I submitted a paper for which a referee review came back recently, recommending minor corrections. There are two methods to calculate some quantities in the literature which do ...
31
votes
5answers
4k views

How to deal with repeated resubmissions of a bad paper (as a reviewer)?

(Context: theoretical computer science.) I just received a review request; I have previously reviewed three previous versions of the same submission (twice for conferences, once for a journal), ...
31
votes
3answers
2k views

Dealing with uncertainty when reviewing a paper

I agreed to review a paper that falls within my area of expertise. However, I am not particularly familiar with one of the techniques used by the authors. On detailed reading, their use of this ...
31
votes
3answers
3k views

What is the right place to acknowledge another (simultaneous) paper with the same result?

I'm refereeing a paper for a math journal at the moment. As happens fairly often, some other folks came up with basically the same result independently at the same time, I think the manuscripts ...
31
votes
1answer
3k views

Paper accepted with no report?

I submitted a 60-page paper to a reasonable math journal (Journal of Algebra) about 6 months ago. A few days ago I received an email stating that my paper was accepted. I did not get a referee report. ...
31
votes
7answers
9k views

Is it legal to upload a paper to arXiv when it is under double blind review for one of the IEEE journals?

Is it legal to upload a paper to arXiv when it is under double blind review for one of the IEEE journals? I am suspicious that it may violate the double blind review requirements and I couldn't find ...
31
votes
3answers
7k views

Is my paper under review (or similar) for too long and if yes, how should I react?

I submitted a paper to a journal, and I suspect that it is handled too slowly. How can I decide whether my suspicion is correct? What handling times should I expect? Given some expected handling ...
31
votes
1answer
3k views

As a reviewer, what steps can I take after paper is published despite major scientific and ethical concerns, with no explanation from editor?

I recently reviewed a manuscript for a journal I didn't know very well, but which was indexed on Pubmed and Scopus and seemed to be legitimate. In my review, I recommended rejection based on what I ...
30
votes
6answers
8k views

Where to publish research if I do not want a peer review process?

I have a few papers, one of which is on a topic that, after thorough checking, has not been researched from this particular angle before. My question is where can I publish this without going ...
30
votes
6answers
5k views

Writing referee report: found major error, now what?

I'm writing a referee report on a paper. This paper is interesting and, if correct, would be worth publishing. However, I believe they have a major mistake in their method which invalidates their ...
30
votes
6answers
931 views

Open versus Blind reviewing process

A question I have been wondering for a while is if there exists an actual proof that a blind reviewing process (i.e. where the reviewers are anonymous, and the reviews not published) is better than an ...
30
votes
2answers
7k views

How to acknowledge contributions of anonymous referee in new paper?

I'm in mathematics, just in case that matters. I submitted a manuscript to a journal, and got an extensive referee report from referee X. After sending the revision, the paper got rejected, so I sent ...
29
votes
3answers
4k views

Pros and cons of writing a book review?

I am a postdoc in a biology department. I am friends with a professor in the philosophy department who is the editor of a Nature journal which publishes book reviews. A 150-page popular science book ...
29
votes
5answers
6k views

Should I list people who are in competition with me as reviewers to exclude for “conflict of interest”?

I am submitting a a paper to a top conference and I need to determine the reviewers with conflicts of interests. There is a big competition in having papers accepted at this conference, among people ...
29
votes
5answers
5k views

How to respond to a tough referee report?

We received two referee reports from the editor, who made a major revision decision. One referee has a long list of comments, while on the whole it is positive towards our paper. But the other one ...
29
votes
6answers
2k views

Is it common for research disciplines to have a large gap between theory and practice?

TL;DR: Is it normal that the theory sub-community and the applied sub-community of a single research field to have different goals and different standards for peer review - to the extent that the ...
29
votes
2answers
1k views

How does peer-review work for “gigantic” collaboration projects?

Big collaboration projects such as LHC experiments (ATLAS, ALICE _e.g.) and LIGO result in academic papers featuring hundreds or even more than 1000 authors. Correct me if I’m wrong, but in fields ...
28
votes
5answers
9k views

Should you correct grammar mistakes during peer review?

In almost any paper there is an abundance of classical errors, such as omitting the "s" at the end of a third person singular verb. I am growing tired of painstakingly listing the page and line for ...
28
votes
4answers
6k views

Why do non-governmental organizations tend to publish non peer-reviewed “grey” literature?

Is there any reason why most non-governmental organizations (NGOs) tend to publish non-peer reviewed literature? I have seen some NGO scientists as co-authors, even in some important papers, but most ...
28
votes
5answers
5k views

Do author name(s) dominate the content of the paper?

Suppose I did not publish any papers till now in reputed journals and I want to publish a paper with a novel idea. Colleagues are suggesting me to ask any expert to proofread the paper and then to ...
28
votes
4answers
5k views

Level of detail when reviewing the language of a low quality paper

I am currently reviewing a computer science conference paper. I like to give constructive feedback both related to the content as well as for language issues, such as typos or grammatical mistakes. ...
28
votes
8answers
4k views

How accurate are published papers?

I'm an undergrad trying to publish findings on the accuracy of consumer-grade motion sensors for IEEE. I've searched for existing literature on this topic, and I've found some interesting articles. ...
28
votes
5answers
5k views

Referee did not fully understand accepted paper

I just got a paper accepted without revisions in a prestigious journal. This is of course nice. Reading the referee report makes me a bit worried, though. It is clear that the referee has gotten the ...
28
votes
4answers
1k views

How to effectively address conflicting suggestions from reviewers

A bit of background, I am doing research in atmospheric physics and detection systems Recently, I received a paper submission back with revisions suggested by a couple of reviewers. For the most ...
28
votes
5answers
954 views

Is it ethical for departments to have publication requirements for students

This question and this question suggest that it is not uncommon/unheard of for departments to require publication by students (generally masters and doctoral) either to get credit for a course or ...
28
votes
5answers
3k views

Who benefits from the anonymity of the peer review process?

I was reading an answer to another question, which says on the topic of a reviewer potentially contacting an author under a special set of circumstances Some would say you should wait until it is ...
28
votes
3answers
6k views

What does “paper rejected provisionally” mean?

I submitted a paper to a prestigious control journal. The editor provided the following review: The decision is that your contribution cannot be accepted for publication in [the journal] in its ...
28
votes
5answers
3k views

How many papers should I be reviewing as a referee?

Like many academics with an active research program, I am asked to review many papers. Borrowing an idea from peer-to-peer file sharing companies, I try to keep a rough sense of my recent "ratio" of ...
28
votes
2answers
997 views

Can a journal withhold referee reports from the authors of a rejected paper?

We submitted a paper to a journal published by Cambridge Press. The paper was submitted last year (2013). After five months we got the decision yesterday. We don't mind the decision, however, we are ...
28
votes
3answers
4k views

Refereeing a lazy, but correct paper [duplicate]

When refereeing a paper, I often have objections to the work that do not rise to the level of using the coercive powers of a referee to delay or reject the work. For instance, I find myself wanting to ...
28
votes
4answers
15k views

When is it appropriate to decline a review request?

There are some clear reasons to decline a review request, such as conflict-of-interests or not enough free time (e.g., going on a vacation..). But what if you are just not interested in the paper you ...
27
votes
9answers
9k views

Is it normal to get an angry review that does not address any point of the work?

I recently submitted a paper for publication. I was amazed to read the tone of one of the reviewers. Previously, it was read by a pair of peers. I am completely sure that they would tell me if they ...
27
votes
7answers
13k views

Why do editors sometimes accept a paper even if a reviewer recommends rejection?

For the last many days, I have a question in mind related with the editorial decision of accepting or rejecting the manuscript after peer-review: Few days back I got a review report from a very ...
27
votes
5answers
1k views

Should a reviewer critique language and text copy-paste issues?

While reviewing research papers, I often find that the author's English is not very good. Considering that English is not everyone's native language, I understand their difficulties, and I recognize ...
27
votes
4answers
3k views

How do journal/conference reviewers make sure of the results' integrity for submitted research papers? [duplicate]

How do reviewers/referees make sure that the author has done the work as he described in his paper and the written results are achieved? Do they ask for the code or the tools that you have used? Will ...
27
votes
5answers
2k views

Can reviewing papers help increase your credibility as a researcher?

I was wondering if reviewing papers for established journals was a way to increase ones credibility as a researcher? My question is related to the fact that the journal editors, that are (frequently)...
27
votes
3answers
1k views

Do editors ever “overbook” referees?

Is the following common? An editor for a journal sends a paper out to, say, three or four referees. After getting the first two referee reports, the editor makes a decision and tells the third and ...
27
votes
5answers
7k views

How much time should I spend on reviewing a paper?

I never tried to avoid becoming a sub-reviewer, and still, this question made me wonder. How much time should I, as a PhD student, spend on a review of a paper that my advisor gave me to do? Does the ...
27
votes
7answers
1k views

How much is submission acceptance to high-profile conferences influenced by internal politics?

I was speaking with several professors in my department about submission to high-profile conferences like CHI in human-computer interaction. Most of the professors were of the opinion that acceptance ...
27
votes
3answers
7k views

Journal rejection after 9 months without proper review: why do journal editors allow this sort of rejection?

I came to know from a senior in my lab that he once submitted a paper in Applied Mathematics in one of SIAM journals and the review came after 9 months and the review was like the following: Reviewer ...
27
votes
5answers
4k views

How to handle newly discovered problems in second and third round reviews

For the first time, I had to review a revision of an academic paper (I have already reviewed several other papers, but they were all rejected after the first round). While the authors had clearly ...
27
votes
6answers
3k views

What to do when you are suspicious about numerical results in a submitted manuscript that you are reviewing?

I am currently reviewing a paper and feel suspicious about their numerical results. I feel their results have been slightly modified to exhibit their superiority compare to other comparative methods. ...
27
votes
2answers
5k views

Under what circumstances can one republish a conference paper/presentation?

For conferences that "peer review" and "publish" full papers, when, if ever, can you resubmit essentially unchanged versions for publication in a peer reviewed journal? In my field, when conference ...
27
votes
3answers
1k views

Should conference papers in computer science contain full proofs, and should these be checked by reviewers?

I am a mathematician. In my subject, the normal means of disseminating research is to write it up with full and detailed proofs of the main results, which are then typically subjected to a rigourous ...
26
votes
6answers
5k views

Why call it a “major” revision if the suggested changes are seemingly minor?

I recently got a major revision from an applied math journal. However the only change the reviewer has asked is to put a remark on some theorem in the paper (why the specified theorem will not work ...
26
votes
6answers
6k views

What makes papers publishable in top-tier journals?

What are some factors that enable some papers to be published in top-tier journals while others (apparently similar) cannot? For example, in the field of control theory, there are so many papers with ...
26
votes
5answers
7k views

Who can submit papers to peer-reviewed journals?

Financial terms, content quality, etc, is not a problem. The author has a contribution that will significantly impact the advancement of human knowledge about a particular topic. Can anyone submit a ...