40

I work in engineering and I was warned by a colleague years ago that I should not cite materials on arXiv because they are not peer reviewed. Although it was never clear to me what peer reviewed meant because the papers on there seemed to be well maintained and the ones I have came across has been theoretically sound. Academia stackexchange certainly didn't help in relieving some of those anxieties with people asking if they are "ruined" for posting on arXiv.

One can understand my point of view better by considering that in engineering there are well established conferences and list of papers published through those conferences (although not all high quality). Browsing through a list of citations published by engineers, there is a definitive lack of "arXiv" related papers. This is exacerbated by the fact that arXiv papers seem to be less applied and more theoretical, "mathy", so they are largely hidden from view for the typical engineer.

But from my recent experiences, it seems that a few fairly notable researchers in my field have extensive track record of publishing materials on arXiv. People such as Steven Strogatz who works in nonlinear dynamical systems and John Baez. I have hypothesized in the past that very well established researchers are submitting papers on arXiv instead of science journals because they would like a wider audience, and undergraduate researchers are submitting on arXiv because there is no other venue for them. But of course I am not sure if that is indeed the case.

Now I am currently reading some material published on arXiv by someone who I am not very familiar with. I am still not 100% confident on the "quality" of the paper i.e. scientific accuracy of theoretical and experimental results. But I believe that I would be more open to using materials on arXiv in the future if I can understand the motivation behind submitting to arXiv i.e. whether if they are just low quality papers without any other place that accepts them.

Can someone please offer a break down of some the reasons why one would publish to arXiv?

  • Another aspect considered is that science is going into open-access, and arxiv encourages open acces movement in science. – Mikey Mike Aug 17 '16 at 10:40
  • 4
    Your colleague is wrong about not citing papers posted to the arxiv because they are not peer reviewed. You should cite whatever you use and trust, whether it has been peer reviewed or not. If you can't judge for yourself whether a source is reliable, then probably you shouldn't be publishing. – Dan Fox Oct 20 '16 at 7:21
  • @DanFox doesn't what you said apply to Wikipedia as well? – Ooker Mar 13 '18 at 6:43
54

The major use case of arXiv is for disseminating manuscripts that you also publish in a journal or conference. By posting a preprint on arXiv, people can find your research, build on it, cite it, and give you feedback on it immediately, while at the same time the same work goes through the (sometimes slow) peer review process. Some of these papers will fall out of the peer review pipeline at some point, and only appear on arXiv, but that doesn't necessarily mean that they are less useful, important, or sound.

To give a specific example, in the last year or so I have been working in an area so new that most of the relevant research is still only available on arXiv. I expect these papers will eventually appear in journals too, but the slow peer review process means that the latest journal issues do not represent the state of the art for this particular topic. Conferences have a quicker peer review cycle and are more current, but most only publish relatively short papers.

arXiv is also useful for work that is in a format not suited for a conference or journal (e.g. a thesis), or for extended versions of papers that are published somewhere else.

I would caution against rules like "I should not cite materials on arXiv because they are not peer reviewed." Peer review does not guarantee sound, high quality research, nor is the inverse true. You should critically evaluate each paper, peer reviewed or not, on its individual merits. (Also see this related question on Math Overflow.)

  • 1
    @ÉbeIsaac As far as I know, Scopus does not count citations to the Arxiv version of a paper. Which is one reason to cite the published version (if it exists) rather than the Arxiv one. – Federico Poloni Aug 17 '16 at 9:42
  • 1
    "You should critically evaluate each paper, peer reviewed or not, on its individual merits." If don't use peer review as a guideline on what's worth your critical evaluation, you basically deny the sense of peer reviews. Also, your life would end before you'd manage to find anything useful. – BartoszKP Aug 17 '16 at 9:51
  • 1
    @BartoszKP: I disagree. Peer reviews are useful, but not mandatory. Many peer-reviewed publications have serious flaws slip through them, even in reputable journals. At cases, even a gist/idea can help look at a problem at a new angle to solve it, it does not necessarily require a slow peer reviewer to valuate that. Sometimes (actually a lot of times), the process can even take up to 4-6 years. In such cases many methods tend to get outdated even before they are published. – Ébe Isaac Aug 17 '16 at 10:07
  • 1
    @ÉbeIsaac I didn't say they are mandatory - I meant they are useful, because I understood the part I quoted as a suggestion that they are not useful at all. Of course it may be beneficial to browse&skim through non-reviewed papers, but definitely not "critically evaluate" all of them (well, depending on your field of course and the number of papers available). – BartoszKP Aug 17 '16 at 10:17
  • 2
    I would upvote this question so many times, if I could, even only for the "Peer review does not guarantee sound, high quality research, nor is the inverse true.". Finally someone who understands that peer review is not the truth come down to Earth. – gented Aug 17 '16 at 13:39
18

Other reasons why authors post their papers on arXiv before or around the same time as submitting to a journal are:

  1. To claim scientific priority: Delays at the journal end might lead to your research getting scooped. Publishing on arXiv lets the world know that you were the first one to come up with these results.

  2. To get comments from peers: ArXiv allows others to comment on articles that are posted. This acts as an open peer review, where others in your field give feedback and suggest improvements that will help improve your paper and thereby increase your chances of acceptance by a journal. You can revise your paper based on these comments before submitting to a journal.

  3. To give readers access to their article: Some articles are not widely read because readers don't have subscription to the article. Also, authors sometimes cannot afford the charges for publishing their article open access. In such cases, posting on arXiv ensures a wider readership and could even lead to more citations.

I've written an article about preprints recently which you might find interesting: The role of preprints in reasearch dissemination

  • How does one access the comments for a particular paper on arXiv? Could you clarify the meaning of "preprint" – Carlos - the Mongoose - Danger Aug 17 '16 at 17:19
11

Part of your question seems to be "Why do some researchers submit to arXiv while others don't"?

A point not yet mentioned: arXiv only covers a few specific subject areas. It's the very first line on the home page:

Open access to 1,175,314 e-prints in Physics, Mathematics, Computer Science, Quantitative Biology, Quantitative Finance and Statistics

Since engineering isn't on that list, that would be an excellent reason for most engineering researchers not to post their work to arXiv.

The "notable researchers in your field" who you mention as being prolific arXiv posters are, in some sense, not really in your field. Strogatz is a mathematician and Baez is a mathematical physicist. Both those fields are covered by arXiv, so it makes sense that they would use it.

Now it's entirely possible that although you think of your field as engineering, some of your papers might contain "enough" physics or mathematics to be on-topic for the corresponding sections of arXiv. But you might have to think about it first.

It should also be strongly emphasized that these people are not submitting to arXiv instead of peer-reviewed journals, but in addition to. This is perfectly acceptable by the standards of most journals in mathematics and physics. There are plenty of peer-reviewed outlets for their work and they're using them. Just look at their CVs.

  • 4
    Now it's entirely possible that although you think of your field as engineering, some of your papers might contain "enough" physics or mathematics to be on-topic ... — In case folks are wondering, in electrical engineering, for example, researchers working in information theory, machine / statistical learning, control, and on various optimization problems post quite a bit on arXiv. – Mad Jack Aug 17 '16 at 15:16
5

The most important thing is to know if peer-reviewed journals in your field will accept to publish your article if it has previously been published on arXiv.

In my field, chemistry, the answer is no, so publishing on arXiv has never been an option. Note though that some publishers allow an accepted paper to be published on arXiv, but that is after it has been accepted.

Not the answer you're looking for? Browse other questions tagged or ask your own question.