Questions tagged [peer-review]

On the evaluation of work (typically, a publication or grant proposal) by the author's peers. This includes: refereeing, which is often used to determine an academic paper's suitability for publication in a journal or conference; peer evaluation of teaching skills; peer review of research grant proposals; and post-publication review of a book or article, as is common in the field of mathematics.

Filter by
Sorted by
Tagged with
27
votes
4answers
4k views

Is it normal to ask to see the entire manuscript (not just the abstract) before accepting a peer-review invitation?

I apologize if this question has been asked before. I received a peer-review invitation from a journal to review a paper. In the email there is just the author's name and the title of the article and ...
27
votes
5answers
1k views

Should a reviewer critique language and text copy-paste issues?

While reviewing research papers, I often find that the author's English is not very good. Considering that English is not everyone's native language, I understand their difficulties, and I recognize ...
27
votes
5answers
4k views

What to do when the claims in a paper are proven to be wrong?

What can be done to correct an error that might be hiding a certain author's sole purpose of publishing a paper, no matter the soundness of their method? In a nutshell, the particular case that ...
27
votes
4answers
3k views

How do journal/conference reviewers make sure of the results' integrity for submitted research papers? [duplicate]

How do reviewers/referees make sure that the author has done the work as he described in his paper and the written results are achieved? Do they ask for the code or the tools that you have used? Will ...
27
votes
5answers
2k views

Can reviewing papers help increase your credibility as a researcher?

I was wondering if reviewing papers for established journals was a way to increase ones credibility as a researcher? My question is related to the fact that the journal editors, that are (frequently)...
27
votes
3answers
1k views

Do editors ever “overbook” referees?

Is the following common? An editor for a journal sends a paper out to, say, three or four referees. After getting the first two referee reports, the editor makes a decision and tells the third and ...
27
votes
7answers
1k views

How much is submission acceptance to high-profile conferences influenced by internal politics?

I was speaking with several professors in my department about submission to high-profile conferences like CHI in human-computer interaction. Most of the professors were of the opinion that acceptance ...
27
votes
3answers
8k views

Journal rejection after 9 months without proper review: why do journal editors allow this sort of rejection?

I came to know from a senior in my lab that he once submitted a paper in Applied Mathematics in one of SIAM journals and the review came after 9 months and the review was like the following: Reviewer ...
27
votes
5answers
4k views

How to handle newly discovered problems in second and third round reviews

For the first time, I had to review a revision of an academic paper (I have already reviewed several other papers, but they were all rejected after the first round). While the authors had clearly ...
27
votes
4answers
5k views

What happens if the editor cannot find reviewers?

I submitted to a journal a couple of months ago. The editorial flow is somehow quick and very transparent. I receive notifications for all events happening to the manuscript. Unfortunately, the ...
27
votes
7answers
1k views

How to review bogus science without hurting feelings?

I've been forwarded a four-page outline of some sort of "theory of everything" whose ambition is to explain just about everything in the universe in terms of particles oscillating in and out of some ...
27
votes
4answers
1k views

Recommending a paper for rejection, then publishing my own

My question is similar to this one I am an editor for a lousy paper and I found a better algorithm than theirs. Must I share it with them? although there are some small distinctions that (I think) ...
27
votes
3answers
1k views

Should conference papers in computer science contain full proofs, and should these be checked by reviewers?

I am a mathematician. In my subject, the normal means of disseminating research is to write it up with full and detailed proofs of the main results, which are then typically subjected to a rigourous ...
26
votes
4answers
6k views

Can I challenge a paper already published in a peer reviewed conference/journal?

I recently came across several papers in the area of Information Extraction and Data Mining which seem to have passed the review process even if they (1) use some new terminology without describing it,...
26
votes
3answers
5k views

How to be a good reviewer when suspecting dubious results or being sent contributions outside my field of expertise?

Recently I have been appointed as a reviewer for an IEEE journal in CS. This journal is indexed on Scimago and its ranking is a Q3 journal. I know that one cannot know all the topics covered in the ...
26
votes
2answers
4k views

Thanking a “shepherd” in acknowledgments

I often find in many conference papers submitted by US research groups that paper writers would thank their "shepherd" in the acknowledgment section. What is the exact contribution of a "shepherd" to ...
26
votes
6answers
1k views

Soliciting pre-submission manuscript comments from people who could later be peer reviewers

Before submitting a manuscript to a journal, it is fairly common at least in my field (psychology) to circulate the manuscript in a limited way to a small number of people who are experts in the area ...
26
votes
5answers
8k views

What is the most likely cause of short, quick, and useless reviews? [closed]

My theoretical computer-science paper that I submitted to an Australian (i.e., located in Australia this year) B-level (according to http://portal.core.edu.au/conf-ranks) DBLP-listed computer-science ...
26
votes
7answers
25k views

Difference between “referee” and “reviewer” in the context of journal manuscript review?

I've seen the terms "referee" and "reviewer" both used to describe a person who gives feedback to a paper in a journal submission. Are there differences between the two terms? Is one used in some ...
26
votes
4answers
3k views

Personal repercussions for those who actively ignore review requests?

A colleague recently submitted an article to a reputable journal. The article went to 6 reviewers, one of which completed the review and the other 5 of which completely ignored the request. The ...
26
votes
1answer
4k views

How should one interpret a rejection on the grounds that a paper “has no added value to the existing state of the art”?

I've got a rejection for my paper that was submitted to a high impact journal; after waiting 6 weeks instead of 4 normally it was rejected with only one referee comment 4 lines: This study seems to ...
26
votes
2answers
5k views

How to make a paper anonymous for reviewers when it heavily extends on your own previous work?

I am writing a paper that continues and extends my previous paper (the usual situation), and I plan to submit it to a journal that conducts a double-blind review. It is a research that started ...
26
votes
2answers
1k views

Can a referee request a paper referenced in the reviewed paper?

If you review a paper which relies on results some other paper and you do not have access to that paper, is it acceptable to contact the editor and ask whether the author can provide a copy of the ...
26
votes
6answers
6k views

Co-authors not willing to publish after rejection. May I drop them?

We wrote a case report (1 + 2 co authors). The case report was not accepted. I tried to convince the other co-authors to re-write and submit. I waited for 3 years and 6 months. The co-authors showed ...
26
votes
4answers
664 views

Measure of review bias

I was reading the other day this blog post, about "how to peer review", and one passage struck me: Don't review like a grad student Reviews written by graduate students are among the most ...
25
votes
6answers
6k views

How to React to Incorrect Claims by Reviewers?

As this has happened to me several times for different papers now, I am not describing a specific case here, but the abstract aspects that were common to all situations. Occasionally, in the "Tasks" ...
25
votes
6answers
6k views

What makes papers publishable in top-tier journals?

What are some factors that enable some papers to be published in top-tier journals while others (apparently similar) cannot? For example, in the field of control theory, there are so many papers with ...
25
votes
5answers
3k views

Does careful selection of graph colors in a manuscript have any positive impact on reviewers?

I have just completed an article in which results are interpreted by means of 3D-plots; there are almost 15 plots in my article. Since plots could have a major impact on the reviewers’ decision, I am ...
25
votes
3answers
4k views

Should one apologize in response letters to reviewers? If not, why not?

A student co-author drafted a response letter to the reviewers in which they apologize numerous times. I found this strange, but I can't pinpoint why. Question: Should one apologize in response ...
25
votes
3answers
2k views

Is it ethical to explicitly or implicitly bias against student papers unless co-authored with senior researcher(s)?

A few days ago I was browsing open-access social-science journals and I found one ‘author guideline’ explicitly saying that they are accepting student submissions if and only if the manuscript is co-...
25
votes
4answers
7k views

My paper was accepted, but I found an error affecting all of the figures. What will happen next?

I submitted a paper to a journal, and the decision was "accept with minor revisions." As I was addressing the reviewer questions to submit a final copy, I realized that I may have misrepresented the ...
25
votes
2answers
21k views

What are the different roles between a program committee member and reviewer?

Does someone know what are the different roles between a Program Committee (PC) member and Reviewer for conferences (e.g., in the field of machine learning)?
25
votes
2answers
15k views

How to write a rebuttal for a conference

What are good practices (does and don'ts) when writing a rebuttal for a conference? For example, for a journal rebuttal letter you can make changes to your paper, and resubmit it for another revision....
25
votes
3answers
2k views

Can I show my co-author the final version of an accepted publication I reviewed?

I was reviewing a journal paper recently that is closely related to work a colleague and I are doing. We are currently in the process of writing up our paper, and I plan to cite the paper I reviewed ...
25
votes
1answer
3k views

Is it OK to decline a review request after multiple resubmissions?

I have served as a reviewer for a few journals multiple times, and I typically take the task very seriously and aim to provide informative and constructive reviews. However, there's this one case that ...
25
votes
5answers
1k views

How ambitious should one be in picking a journal to submit to?

I've finished a mathematics paper with two co-authors, and I need to decide on a journal to submit it to. More so than my other papers, I don't have much of a sense for how "good" it is. It is a ...
25
votes
2answers
2k views

If I refereed a paper at one journal (and it was rejected) should I referee it again when it's sent to another journal?

A couple months ago I refereed a paper for one journal. Due to a number of factors, I recommended that it not be published in that particular journal, and gave the author a bunch of comments on how ...
25
votes
3answers
500 views

Do I have to adapt my reviews according to the quality of a journal?

Recently, I received to review two manuscripts dealing with similar topics. According to the JCR quality measures, the first one was from top tier journal and the second one from the last quartile (Q4)...
25
votes
1answer
2k views

How should I handle reviewing a paper that is very similar to something I am working on?

I was sent a paper to review recently. I decided to review the paper and saw that part of the paper is on a very similar method that I have been working on recently. Not the wording, of course, but ...
25
votes
4answers
1k views

As an editor, what measures can I implement to prevent image/photo manipulation?

There's been a case of alleged data manipulation in a recent Nano Letters paper (initial report here; now-retracted paper):      You can surely make your own opinion on whether the images have been ...
24
votes
7answers
8k views

How to handle a possibly biased editor?

Suppose a journal editor rejects a manuscript with only one reviewer’s feedback, but the few comments the reviewer and editor made were almost entirely minor comments (e.g. “use these units for this ...
24
votes
2answers
7k views

Response to referee after rejection

I recently had a paper rejected: both referees pointed to a unique issue with our work. One referee's criticism was fair, hence I feel the rejection decision was fair. The other referee however, ...
24
votes
5answers
3k views

Is it a bad idea to submit a paper merely to elicit reviewers' comments?

Some days ago I was talking with a friend of mine, who is currently a post-doc at the illustrious Italian Institute of Technology (IIT) working on humanoid robotics. He was quite disgruntled because ...
24
votes
3answers
3k views

Reviewer recommending citation of certain papers of specific group of authors may be himself

Recently I had a challenge in responding to a reviewer (#2) for revising our work. The reviewer asked us to refer 16 papers in multiple parts of the paper. I decided to refer some of these references ...
24
votes
4answers
4k views

Submitting a paper to a new journal with responses for the rejection to the first journal

I submitted my paper in IEEE Transcations of XXX and got a rejection. But the comments were really helpful and has helped me a lot in improving the paper. But, unfortunately, I cannot resubmit that ...
24
votes
7answers
4k views

Should a graduate student accept random offer to be a reviewer for IEEE Transactions paper?

I have been asked by a well-established professor to review a regular paper submitted to IEEE Transactions, however, I am concerned as in the email, he titled me "Dr. Monkia" although I am still being ...
24
votes
7answers
7k views

Publons - is it a serious thing?

Recently several different, unrelated publishers suggested on their websites to join Publons, which is meant to acknowledge referees for peer-reviewing submitted manuscripts. Publons even suggests to ...
24
votes
3answers
5k views

Is it acceptable to say that a reviewer's concern is not going to be addressed because then the paper would be too long?

It is my understanding that philosophy papers have less chance of being published if they are over 7,000 or 8,000 words long. But at the same time we philosophers often complain that a given author's ...
24
votes
4answers
1k views

What to do when a referee asks for changes I am not willing to make?

I have submitted a paper later that was reviewed by four reviewers. I submitted my revisions to all reviewers. Three accepted the review, while the last is still asking for modifications. The ...
24
votes
3answers
3k views

How to review a major revision of a paper?

A few months ago I reviewed my first paper. The authors submitted a major revision and I am asked to review the paper again. I received a long cover letter where my comments and the comments of two ...