Questions tagged [reproducible-research]

Questions related to research in which data and/or code is made publicly available so that others may verify the findings and build upon them.

Filter by
Sorted by
Tagged with
39
votes
4answers
10k views

Requesting raw data from previously published research

I am working on a mathematical model to help explain some experimental results and generate new hypotheses. Unfortunately, I have neither the resources nor interest to gather experimental data, but in ...
33
votes
4answers
20k views

Can I request the code behind a research paper from the author?

I am in the field of computer science. It is often the case when I am reading a paper I start to wonder, "Wow stunning results, however, I would like to prove that." or "How exactly did he get these ...
61
votes
8answers
5k views

What should you do if you cannot reproduce published results?

I am trying to reproduce published results in a paper. Those results come from numerical simulations. The original authors and I do not use the same software, and theirs is proprietary (I don't have ...
36
votes
3answers
3k views

How to get the data to reproduce a published result?

I'm studying published journal articles on my topic, and I'd like to reproduce their analysis. How can I get a copy of their dataset and enough specifications to reproduce their numerical results? ...
30
votes
5answers
1k views

Data publication basics - where, why, how, and when should I publish my unpublished data?

Many researchers have unpublished data. Some of this data may never be published as a manuscript. But I would like to make scholarly contributions of data that I have no intent on publishing, e.g. by ...
57
votes
7answers
3k views

Popular proprietary program or obscure open source substitute for reproducible research?

For a long time, I had been using open source software for my work to boost "reproducible research". I believed that if I made my codes open source and the softwares to run those codes in were open ...
27
votes
4answers
3k views

Why are papers accepted even if they don't release code or data to allow reproducibility?

Recently, we had a lecture about Reproducible research on of the slides was: Reproducibility: start from the same samples/data, use the same methods, get the same results. Replicability: ...
10
votes
2answers
3k views

What is the difference between repeatability, replicability and reproducibility?

I have seen many instances where authors used the term "reproducibility" and "replicability" interchangeably in the social and behavioural sciences. Sometimes, they distinguish between the "...
24
votes
2answers
2k views

As a reviewer, how much raw data or code should you request?

The topic of reproducible research is attracting quite some press these days, yet much remains to be done. In this spirit, I am asking what can be a reviewer's role in this — I'll explain fully below. ...
60
votes
6answers
12k views

How to proceed when the baseline (state-of-the-art) published results claim much better performance than I can reproduce?

I am graduate student, to finish my degree I need to build methods outperform what is already there. An issue that I came across with, is that two papers reported way (I mean more than 20%) more than ...
16
votes
2answers
493 views

I've reproduced a paper: where shall I share the code and findings?

The majority of papers don't share their code. However, I sometimes want to reproduce the results, and therefore re-code the experiments to try to reproduce the papers. Where shall I share the code, ...
15
votes
3answers
1k views

Can you do a PhD solely on repeating experiments of others?

In here, they say there is a problem with results not being replicated. I know a PhD is supposed to be "original" research. But could you do a PhD solely on replicating the results of others? ...
3
votes
2answers
252 views

Incentives for independent researchers to work on reproducible research

For the sake of high-quality science diffusion, there is no doubt that reproducible research is a good practice as it helps to demonstrate the robustness of the proposed methods and boosts the ...
6
votes
2answers
247 views

Is it beneficial for a student to publish their research code and data?

There are at least four benefits of releasing the code and data produced during a thesis or research project (citing textually this laboratory): Allows to reproduce figures in the revisions of a ...
6
votes
2answers
249 views

How to address an author showing replicated results from his paper?

I have replicated a method of interpolation recently proposed by certain author, and I want to tell him that I have done so. I suppose the author is interested in knowing that students are engaged ...