The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [peer-review]

On the evaluation of work (typically, a publication or grant proposal) by the author's peers. This includes: refereeing, which is often used to determine an academic paper's suitability for publication in a journal or conference; peer evaluation of teaching skills; peer review of research grant proposals; and post-publication review of a book or article, as is common in the field of mathematics.

Filter by
Sorted by
Tagged with
27
votes
3answers
7k views

Journal rejection after 9 months without proper review: why do journal editors allow this sort of rejection?

I came to know from a senior in my lab that he once submitted a paper in Applied Mathematics in one of SIAM journals and the review came after 9 months and the review was like the following: Reviewer ...
27
votes
5answers
4k views

How to handle newly discovered problems in second and third round reviews

For the first time, I had to review a revision of an academic paper (I have already reviewed several other papers, but they were all rejected after the first round). While the authors had clearly ...
27
votes
6answers
3k views

What to do when you are suspicious about numerical results in a submitted manuscript that you are reviewing?

I am currently reviewing a paper and feel suspicious about their numerical results. I feel their results have been slightly modified to exhibit their superiority compare to other comparative methods. ...
27
votes
7answers
1k views

How to review bogus science without hurting feelings?

I've been forwarded a four-page outline of some sort of "theory of everything" whose ambition is to explain just about everything in the universe in terms of particles oscillating in and out of some ...
27
votes
4answers
1k views

Recommending a paper for rejection, then publishing my own

My question is similar to this one I am an editor for a lousy paper and I found a better algorithm than theirs. Must I share it with them? although there are some small distinctions that (I think) ...
27
votes
3answers
1k views

Should conference papers in computer science contain full proofs, and should these be checked by reviewers?

I am a mathematician. In my subject, the normal means of disseminating research is to write it up with full and detailed proofs of the main results, which are then typically subjected to a rigourous ...
26
votes
5answers
7k views

Who can submit papers to peer-reviewed journals?

Financial terms, content quality, etc, is not a problem. The author has a contribution that will significantly impact the advancement of human knowledge about a particular topic. Can anyone submit a ...
26
votes
4answers
6k views

Can I challenge a paper already published in a peer reviewed conference/journal?

I recently came across several papers in the area of Information Extraction and Data Mining which seem to have passed the review process even if they (1) use some new terminology without describing it,...
26
votes
5answers
4k views

What to do when the claims in a paper are proven to be wrong?

What can be done to correct an error that might be hiding a certain author's sole purpose of publishing a paper, no matter the soundness of their method? In a nutshell, the particular case that ...
26
votes
3answers
5k views

How to be a good reviewer when suspecting dubious results or being sent contributions outside my field of expertise?

Recently I have been appointed as a reviewer for an IEEE journal in CS. This journal is indexed on Scimago and its ranking is a Q3 journal. I know that one cannot know all the topics covered in the ...
26
votes
2answers
4k views

Thanking a “shepherd” in acknowledgments

I often find in many conference papers submitted by US research groups that paper writers would thank their "shepherd" in the acknowledgment section. What is the exact contribution of a "shepherd" to ...
26
votes
6answers
1k views

Soliciting pre-submission manuscript comments from people who could later be peer reviewers

Before submitting a manuscript to a journal, it is fairly common at least in my field (psychology) to circulate the manuscript in a limited way to a small number of people who are experts in the area ...
26
votes
5answers
8k views

What is the most likely cause of short, quick, and useless reviews? [closed]

My theoretical computer-science paper that I submitted to an Australian (i.e., located in Australia this year) B-level (according to http://portal.core.edu.au/conf-ranks) DBLP-listed computer-science ...
26
votes
7answers
23k views

Difference between “referee” and “reviewer” in the context of journal manuscript review?

I've seen the terms "referee" and "reviewer" both used to describe a person who gives feedback to a paper in a journal submission. Are there differences between the two terms? Is one used in some ...
26
votes
4answers
3k views

Personal repercussions for those who actively ignore review requests?

A colleague recently submitted an article to a reputable journal. The article went to 6 reviewers, one of which completed the review and the other 5 of which completely ignored the request. The ...
26
votes
1answer
4k views

How should one interpret a rejection on the grounds that a paper “has no added value to the existing state of the art”?

I've got a rejection for my paper that was submitted to a high impact journal; after waiting 6 weeks instead of 4 normally it was rejected with only one referee comment 4 lines: This study seems to ...
26
votes
4answers
5k views

What happens if the editor cannot find reviewers?

I submitted to a journal a couple of months ago. The editorial flow is somehow quick and very transparent. I receive notifications for all events happening to the manuscript. Unfortunately, the ...
26
votes
2answers
5k views

How to make a paper anonymous for reviewers when it heavily extends on your own previous work?

I am writing a paper that continues and extends my previous paper (the usual situation), and I plan to submit it to a journal that conducts a double-blind review. It is a research that started ...
26
votes
2answers
1k views

Can a referee request a paper referenced in the reviewed paper?

If you review a paper which relies on results some other paper and you do not have access to that paper, is it acceptable to contact the editor and ask whether the author can provide a copy of the ...
26
votes
6answers
6k views

Co-authors not willing to publish after rejection. May I drop them?

We wrote a case report (1 + 2 co authors). The case report was not accepted. I tried to convince the other co-authors to re-write and submit. I waited for 3 years and 6 months. The co-authors showed ...
26
votes
4answers
651 views

Measure of review bias

I was reading the other day this blog post, about "how to peer review", and one passage struck me: Don't review like a grad student Reviews written by graduate students are among the most ...
25
votes
6answers
6k views

What makes papers publishable in top-tier journals?

What are some factors that enable some papers to be published in top-tier journals while others (apparently similar) cannot? For example, in the field of control theory, there are so many papers with ...
25
votes
3answers
3k views

Reviewer recommending citation of certain papers of specific group of authors may be himself

Recently I had a challenge in responding to a reviewer (#2) for revising our work. The reviewer asked us to refer 16 papers in multiple parts of the paper. I decided to refer some of these references ...
25
votes
5answers
3k views

Does careful selection of graph colors in a manuscript have any positive impact on reviewers?

I have just completed an article in which results are interpreted by means of 3D-plots; there are almost 15 plots in my article. Since plots could have a major impact on the reviewers’ decision, I am ...
25
votes
4answers
4k views

Is it normal to ask to see the entire manuscript (not just the abstract) before accepting a peer-review invitation?

I apologize if this question has been asked before. I received a peer-review invitation from a journal to review a paper. In the email there is just the author's name and the title of the article and ...
25
votes
3answers
4k views

Should one apologize in response letters to reviewers? If not, why not?

A student co-author drafted a response letter to the reviewers in which they apologize numerous times. I found this strange, but I can't pinpoint why. Question: Should one apologize in response ...
25
votes
3answers
2k views

Is it ethical to explicitly or implicitly bias against student papers unless co-authored with senior researcher(s)?

A few days ago I was browsing open-access social-science journals and I found one ‘author guideline’ explicitly saying that they are accepting student submissions if and only if the manuscript is co-...
25
votes
4answers
7k views

My paper was accepted, but I found an error affecting all of the figures. What will happen next?

I submitted a paper to a journal, and the decision was "accept with minor revisions." As I was addressing the reviewer questions to submit a final copy, I realized that I may have misrepresented the ...
25
votes
2answers
15k views

How to write a rebuttal for a conference

What are good practices (does and don'ts) when writing a rebuttal for a conference? For example, for a journal rebuttal letter you can make changes to your paper, and resubmit it for another revision....
25
votes
3answers
2k views

Can I show my co-author the final version of an accepted publication I reviewed?

I was reviewing a journal paper recently that is closely related to work a colleague and I are doing. We are currently in the process of writing up our paper, and I plan to cite the paper I reviewed ...
25
votes
1answer
3k views

Is it OK to decline a review request after multiple resubmissions?

I have served as a reviewer for a few journals multiple times, and I typically take the task very seriously and aim to provide informative and constructive reviews. However, there's this one case that ...
25
votes
5answers
1k views

How ambitious should one be in picking a journal to submit to?

I've finished a mathematics paper with two co-authors, and I need to decide on a journal to submit it to. More so than my other papers, I don't have much of a sense for how "good" it is. It is a ...
25
votes
2answers
2k views

If I refereed a paper at one journal (and it was rejected) should I referee it again when it's sent to another journal?

A couple months ago I refereed a paper for one journal. Due to a number of factors, I recommended that it not be published in that particular journal, and gave the author a bunch of comments on how ...
25
votes
3answers
497 views

Do I have to adapt my reviews according to the quality of a journal?

Recently, I received to review two manuscripts dealing with similar topics. According to the JCR quality measures, the first one was from top tier journal and the second one from the last quartile (Q4)...
25
votes
1answer
2k views

How should I handle reviewing a paper that is very similar to something I am working on?

I was sent a paper to review recently. I decided to review the paper and saw that part of the paper is on a very similar method that I have been working on recently. Not the wording, of course, but ...
25
votes
4answers
970 views

As an editor, what measures can I implement to prevent image/photo manipulation?

There's been a case of alleged data manipulation in a recent Nano Letters paper (initial report here; now-retracted paper):      You can surely make your own opinion on whether the images have been ...
24
votes
7answers
8k views

How to handle a possibly biased editor?

Suppose a journal editor rejects a manuscript with only one reviewer’s feedback, but the few comments the reviewer and editor made were almost entirely minor comments (e.g. “use these units for this ...
24
votes
6answers
6k views

How to React to Incorrect Claims by Reviewers?

As this has happened to me several times for different papers now, I am not describing a specific case here, but the abstract aspects that were common to all situations. Occasionally, in the "Tasks" ...
24
votes
5answers
3k views

Is it a bad idea to submit a paper merely to elicit reviewers' comments?

Some days ago I was talking with a friend of mine, who is currently a post-doc at the illustrious Italian Institute of Technology (IIT) working on humanoid robotics. He was quite disgruntled because ...
24
votes
2answers
7k views

Response to referee after rejection

I recently had a paper rejected: both referees pointed to a unique issue with our work. One referee's criticism was fair, hence I feel the rejection decision was fair. The other referee however, ...
24
votes
4answers
4k views

Submitting a paper to a new journal with responses for the rejection to the first journal

I submitted my paper in IEEE Transcations of XXX and got a rejection. But the comments were really helpful and has helped me a lot in improving the paper. But, unfortunately, I cannot resubmit that ...
24
votes
7answers
3k views

Should a graduate student accept random offer to be a reviewer for IEEE Transactions paper?

I have been asked by a well-established professor to review a regular paper submitted to IEEE Transactions, however, I am concerned as in the email, he titled me "Dr. Monkia" although I am still being ...
24
votes
7answers
6k views

Publons - is it a serious thing?

Recently several different, unrelated publishers suggested on their websites to join Publons, which is meant to acknowledge referees for peer-reviewing submitted manuscripts. Publons even suggests to ...
24
votes
3answers
5k views

Is it acceptable to say that a reviewer's concern is not going to be addressed because then the paper would be too long?

It is my understanding that philosophy papers have less chance of being published if they are over 7,000 or 8,000 words long. But at the same time we philosophers often complain that a given author's ...
24
votes
4answers
1k views

What to do when a referee asks for changes I am not willing to make?

I have submitted a paper later that was reviewed by four reviewers. I submitted my revisions to all reviewers. Three accepted the review, while the last is still asking for modifications. The ...
24
votes
4answers
2k views

Is it appropriate as a referee to contact an author after the editor rejected the manuscript?

This is related to this question, but it is more a special case of it. I reviewed a manuscript, which was submitted to a reputable traditional journal. The journal has a single-blind review system. I ...
24
votes
2answers
3k views

Who can peer-review articles?

I was unable to find any information online about this. I asked a colleague who told me that there are no restrictions on who may review an article, although he thought it was very unlikely that an un-...
24
votes
2answers
795 views

Are the referees of a journal allowed to reveal the title of the papers they review after the review process?

I am wondering if a referee can reveal the title of the papers he/she has refereed for a journal (either by talking about it in the pub, posting it on facebook or another mean) after the decision has ...
24
votes
2answers
2k views

As a reviewer, how much raw data or code should you request?

The topic of reproducible research is attracting quite some press these days, yet much remains to be done. In this spirit, I am asking what can be a reviewer's role in this — I'll explain fully below. ...
23
votes
5answers
15k views

How to interpret this rejection email from Journal of American Math Society? Anything to read between the lines?

I had submitted a paper manuscript to JAMS (J. of Amer. Math Soc) and recieved the following email 2 months after the submission. Can you help me interpret this email, as to what the situation is and ...