One of the main criticism against arXiv is that while there is some basic filtering, but there is no scientific review of the papers. I wonder whether adding a comment section has already being discussed publicly and why as of now arXiv does not have a comment section.
http://www.nature.com/news/arxiv-preprint-server-plans-multimillion-dollar-overhaul-1.20181 (published on 29 June 2016) has some interesting statistics on whether users want a comment section:
When asked whether arXiv should embark on more transformational changes, respondents gave mixed answers. In particular, some questions focused on whether it should develop into a social forum that allows scientists to comment on papers or leave ratings. A few social-media sites have already been built around the repository for just such purposes — such as SciRate and Arxiv Sanity Preserver — and some argue that the site itself should begin to incorporate such functionalities. “ArXiv should be more dynamic — allowing readers to filter the wheat from the chaff,” says Alán Aspuru-Guzik, a quantum chemist at Harvard University in Cambridge, Massachusetts. But one-third of respondents said that this wasn’t important or that arXiv shouldn’t be doing it. Only 34% voted in favour of such changes.
That response points to a tension between researchers who want to see the site incorporate aspects of open review, and those who want it to stick to its core mission of allowing rapid exchange of scholarly papers, says Rieger. There were hints of a generational divide, with those aged under 30 more in favour of allowing comments. But even those who wanted a more social site said that they were keen to avoid a commenting free-for-all, Rieger adds.
“The message was more or less ‘stay focused on the basic dissemination task, and don’t get distracted by getting overextended or going commercial’,” says Paul Ginsparg, a physicist at Cornell University who launched arXiv in 1991 as a pre-World-Wide-Web-era bulletin board.
Similarly, Hugging Face allows users to comments on arXiv papers e.g. https://huggingface.co/papers/2309.09400:
- Comment systems cost money to develop and moderate.
- Some people may not want their preprint commented on.
- You can comment by submitting your own preprint.
- Third-party sites provide this service.
- Journals do not not have comment sections on their websites.
- I doubt many people are asking for a comment section.
The idea of adding comments in some form (not 'on the arXiv' directly) has had some public discussion. See Tim Gower's blog post Why I've also joined the good guys. Sadly I've seen very little of the idea since, so I don't know what the current state-of-play is.
There is no need for a comment section. The authors have provided their contact information, so you can email them directly with any feedback you have for them.
PLOS has comments, though: http://www.plosone.org/static/commentGuidelines.
When they're used, they don't generate much discussion, so maybe arXiv has guessed right about the user demand for them. http://www.plosone.org/article/comments/info%3Adoi%2F10.1371%2Fjournal.pone.0105948
It's been a while since this post, but this idea is now available at https://alphaxiv.org/
This is a Stanford site that allows you to search for and add comments to any arxiv document. I am not affiliated in any way with the website.
Most submissions have 0 comments right now, but open a famous paper like “Attention is all you need” for a proper demonstration