Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [peer-review]

On the evaluation of work (typically, a publication or grant proposal) by the author's peers. This includes: refereeing, which is often used to determine an academic paper's suitability for publication in a journal or conference; peer evaluation of teaching skills; peer review of research grant proposals; and post-publication review of a book or article, as is common in the field of mathematics.

Filter by
Sorted by
Tagged with
32
votes
5answers
5k views

Journal standards vs. personal standards

I am currently reviewing an applied math paper that I don't think is great; indeed, I am hesitant to accept it even with major revisions. The language is poor, I'm not convinced by the arguments, and ...
32
votes
10answers
5k views

Should I agree to review a paper that I do not fully understand?

I recently received a request to subreview a paper for a top computer science conference. While it is related to my field of research, it is extremely long (the conference does not have a page limit) ...
32
votes
3answers
11k views

Are magazines (journals) “Scientific American” and “Popular Science” peer reviewed?

Wikipedia says that New Scientist publishes articles which are not peer-reviewed. But I found no information about "Scientific American" (SciAm) and "Popular Science" (PopSci).
32
votes
3answers
6k views

Is it normal that journals strongly suggest a professional English editing service?

It is quite common for me to receive emails from the editors of a journal asking me, before or after the referees have given their approval, to review and improve my English. Then, the editor suggests ...
32
votes
5answers
3k views

Will rejecting more papers than I accept reflect negatively on me as a reviewer?

I made a little statistics about my review decisions. I found out that I reject way more papers than I accept. I honestly try to accept the reviewed papers, I read them carefully and my review are ...
32
votes
5answers
4k views

Paper rejected based on “informal review” - any point in appealing?

I've recently been trying to get one of my papers published, and have come across the following issue. I started by submitting it to a fairly high-impact journal. It got three reviews, two of which ...
32
votes
3answers
2k views

Author did not make the major changes asked during the review process

I recently had my first paper to review. Since it was the first one, I took great care to be as constructive as possible and to formulate correct and accurate questions / suggestions. At that time, I ...
32
votes
2answers
2k views

What changes after peer review but prior to final submission are acceptable for a conference paper?

Suppose I write a paper and submit it to a conference. The paper gets some weak rejects and weak accepts and lots of criticism, but the conference is not that prestigious, so they accept it anyway. ...
32
votes
1answer
3k views

Studies over how noisy is it to accept/reject submissions

This year, the NIPS 2014 conference did an interesting experiment: conference chairs duplicated 10% of the submissions (170 papers) and sent them to two different groups of reviewers. The result: 25.9%...
31
votes
7answers
2k views

What to do when a referee wants to criticize someone else through me

A couple of months ago I submitted a paper for which a referee review came back recently, recommending minor corrections. There are two methods to calculate some quantities in the literature which do ...
31
votes
5answers
4k views

How to deal with repeated resubmissions of a bad paper (as a reviewer)?

(Context: theoretical computer science.) I just received a review request; I have previously reviewed three previous versions of the same submission (twice for conferences, once for a journal), ...
31
votes
3answers
2k views

Dealing with uncertainty when reviewing a paper

I agreed to review a paper that falls within my area of expertise. However, I am not particularly familiar with one of the techniques used by the authors. On detailed reading, their use of this ...
31
votes
6answers
953 views

Open versus Blind reviewing process

A question I have been wondering for a while is if there exists an actual proof that a blind reviewing process (i.e. where the reviewers are anonymous, and the reviews not published) is better than an ...
31
votes
3answers
3k views

What is the right place to acknowledge another (simultaneous) paper with the same result?

I'm refereeing a paper for a math journal at the moment. As happens fairly often, some other folks came up with basically the same result independently at the same time, I think the manuscripts ...
31
votes
1answer
3k views

Paper accepted with no report?

I submitted a 60-page paper to a reasonable math journal (Journal of Algebra) about 6 months ago. A few days ago I received an email stating that my paper was accepted. I did not get a referee report. ...
31
votes
3answers
8k views

Is my paper under review (or similar) for too long and if yes, how should I react?

I submitted a paper to a journal, and I suspect that it is handled too slowly. How can I decide whether my suspicion is correct? What handling times should I expect? Given some expected handling ...
31
votes
1answer
3k views

As a reviewer, what steps can I take after paper is published despite major scientific and ethical concerns, with no explanation from editor?

I recently reviewed a manuscript for a journal I didn't know very well, but which was indexed on Pubmed and Scopus and seemed to be legitimate. In my review, I recommended rejection based on what I ...
30
votes
6answers
9k views

Where to publish research if I do not want a peer review process?

I have a few papers, one of which is on a topic that, after thorough checking, has not been researched from this particular angle before. My question is where can I publish this without going ...
30
votes
6answers
5k views

Writing referee report: found major error, now what?

I'm writing a referee report on a paper. This paper is interesting and, if correct, would be worth publishing. However, I believe they have a major mistake in their method which invalidates their ...
30
votes
7answers
7k views

Anonymous reviewer disclosed his identity. Should I thank him by name?

A "friendly" reviewer purposely disclosed his identity to me (the author) during a previous round of reviews of a paper that was not published back then. However, he helped me to make the article ...
30
votes
3answers
4k views

Pros and cons of writing a book review?

I am a postdoc in a biology department. I am friends with a professor in the philosophy department who is the editor of a Nature journal which publishes book reviews. A 150-page popular science book ...
30
votes
5answers
3k views

Who benefits from the anonymity of the peer review process?

I was reading an answer to another question, which says on the topic of a reviewer potentially contacting an author under a special set of circumstances Some would say you should wait until it is ...
30
votes
2answers
7k views

How to acknowledge contributions of anonymous referee in new paper?

I'm in mathematics, just in case that matters. I submitted a manuscript to a journal, and got an extensive referee report from referee X. After sending the revision, the paper got rejected, so I sent ...
29
votes
5answers
6k views

Should I list people who are in competition with me as reviewers to exclude for “conflict of interest”?

I am submitting a a paper to a top conference and I need to determine the reviewers with conflicts of interests. There is a big competition in having papers accepted at this conference, among people ...
29
votes
8answers
4k views

How accurate are published papers?

I'm an undergrad trying to publish findings on the accuracy of consumer-grade motion sensors for IEEE. I've searched for existing literature on this topic, and I've found some interesting articles. ...
29
votes
5answers
5k views

How to respond to a tough referee report?

We received two referee reports from the editor, who made a major revision decision. One referee has a long list of comments, while on the whole it is positive towards our paper. But the other one ...
29
votes
6answers
2k views

Is it common for research disciplines to have a large gap between theory and practice?

TL;DR: Is it normal that the theory sub-community and the applied sub-community of a single research field to have different goals and different standards for peer review - to the extent that the ...
29
votes
3answers
4k views

Refereeing a lazy, but correct paper [duplicate]

When refereeing a paper, I often have objections to the work that do not rise to the level of using the coercive powers of a referee to delay or reject the work. For instance, I find myself wanting to ...
29
votes
2answers
1k views

How does peer-review work for “gigantic” collaboration projects?

Big collaboration projects such as LHC experiments (ATLAS, ALICE _e.g.) and LIGO result in academic papers featuring hundreds or even more than 1000 authors. Correct me if I’m wrong, but in fields ...
28
votes
5answers
10k views

Should you correct grammar mistakes during peer review?

In almost any paper there is an abundance of classical errors, such as omitting the "s" at the end of a third person singular verb. I am growing tired of painstakingly listing the page and line for ...
28
votes
4answers
6k views

Why do non-governmental organizations tend to publish non peer-reviewed “grey” literature?

Is there any reason why most non-governmental organizations (NGOs) tend to publish non-peer reviewed literature? I have seen some NGO scientists as co-authors, even in some important papers, but most ...
28
votes
5answers
5k views

Do author name(s) dominate the content of the paper?

Suppose I did not publish any papers till now in reputed journals and I want to publish a paper with a novel idea. Colleagues are suggesting me to ask any expert to proofread the paper and then to ...
28
votes
4answers
5k views

Level of detail when reviewing the language of a low quality paper

I am currently reviewing a computer science conference paper. I like to give constructive feedback both related to the content as well as for language issues, such as typos or grammatical mistakes. ...
28
votes
5answers
5k views

Referee did not fully understand accepted paper

I just got a paper accepted without revisions in a prestigious journal. This is of course nice. Reading the referee report makes me a bit worried, though. It is clear that the referee has gotten the ...
28
votes
5answers
1k views

Is it ethical for departments to have publication requirements for students

This question and this question suggest that it is not uncommon/unheard of for departments to require publication by students (generally masters and doctoral) either to get credit for a course or ...
28
votes
4answers
1k views

How to effectively address conflicting suggestions from reviewers

A bit of background, I am doing research in atmospheric physics and detection systems Recently, I received a paper submission back with revisions suggested by a couple of reviewers. For the most ...
28
votes
3answers
6k views

What does “paper rejected provisionally” mean?

I submitted a paper to a prestigious control journal. The editor provided the following review: The decision is that your contribution cannot be accepted for publication in [the journal] in its ...
28
votes
5answers
3k views

How many papers should I be reviewing as a referee?

Like many academics with an active research program, I am asked to review many papers. Borrowing an idea from peer-to-peer file sharing companies, I try to keep a rough sense of my recent "ratio" of ...
28
votes
2answers
1k views

Can a journal withhold referee reports from the authors of a rejected paper?

We submitted a paper to a journal published by Cambridge Press. The paper was submitted last year (2013). After five months we got the decision yesterday. We don't mind the decision, however, we are ...
28
votes
4answers
17k views

When is it appropriate to decline a review request?

There are some clear reasons to decline a review request, such as conflict-of-interests or not enough free time (e.g., going on a vacation..). But what if you are just not interested in the paper you ...
28
votes
2answers
6k views

Under what circumstances can one republish a conference paper/presentation?

For conferences that "peer review" and "publish" full papers, when, if ever, can you resubmit essentially unchanged versions for publication in a peer reviewed journal? In my field, when conference ...
27
votes
9answers
10k views

Who are the people reviewing far more papers than they're submitting for review?

I've submitted more papers for review than I've reviewed myself. I try to review as much as I can, but it's limited by incoming requests. Publons says I'm somewhat above the median (of 0.3 reviews : ...
27
votes
9answers
10k views

Is it normal to get an angry review that does not address any point of the work?

I recently submitted a paper for publication. I was amazed to read the tone of one of the reviewers. Previously, it was read by a pair of peers. I am completely sure that they would tell me if they ...
27
votes
6answers
5k views

Why call it a “major” revision if the suggested changes are seemingly minor?

I recently got a major revision from an applied math journal. However the only change the reviewer has asked is to put a remark on some theorem in the paper (why the specified theorem will not work ...
27
votes
7answers
14k views

Why do editors sometimes accept a paper even if a reviewer recommends rejection?

For the last many days, I have a question in mind related with the editorial decision of accepting or rejecting the manuscript after peer-review: Few days back I got a review report from a very ...
27
votes
5answers
1k views

Should a reviewer critique language and text copy-paste issues?

While reviewing research papers, I often find that the author's English is not very good. Considering that English is not everyone's native language, I understand their difficulties, and I recognize ...
27
votes
5answers
4k views

What to do when the claims in a paper are proven to be wrong?

What can be done to correct an error that might be hiding a certain author's sole purpose of publishing a paper, no matter the soundness of their method? In a nutshell, the particular case that ...
27
votes
4answers
3k views

How do journal/conference reviewers make sure of the results' integrity for submitted research papers? [duplicate]

How do reviewers/referees make sure that the author has done the work as he described in his paper and the written results are achieved? Do they ask for the code or the tools that you have used? Will ...
27
votes
5answers
2k views

Can reviewing papers help increase your credibility as a researcher?

I was wondering if reviewing papers for established journals was a way to increase ones credibility as a researcher? My question is related to the fact that the journal editors, that are (frequently)...
27
votes
3answers
1k views

Do editors ever “overbook” referees?

Is the following common? An editor for a journal sends a paper out to, say, three or four referees. After getting the first two referee reports, the editor makes a decision and tells the third and ...