Questions tagged [reproducible-research]

Questions related to research in which data and/or code is made publicly available so that others may verify the findings and build upon them.

Filter by
Sorted by
Tagged with
37
votes
4answers
10k views

Requesting raw data from previously published research

I am working on a mathematical model to help explain some experimental results and generate new hypotheses. Unfortunately, I have neither the resources nor interest to gather experimental data, but in ...
33
votes
4answers
18k views

Can I request the code behind a research paper from the author?

I am in the field of computer science. It is often the case when I am reading a paper I start to wonder, "Wow stunning results, however, I would like to prove that." or "How exactly did he get these ...
60
votes
8answers
4k views

What should you do if you cannot reproduce published results?

I am trying to reproduce published results in a paper. Those results come from numerical simulations. The original authors and I do not use the same software, and theirs is proprietary (I don't have ...
36
votes
3answers
2k views

How to get the data to reproduce a published result?

I'm studying published journal articles on my topic, and I'd like to reproduce their analysis. How can I get a copy of their dataset and enough specifications to reproduce their numerical results? ...
30
votes
5answers
1k views

Data publication basics - where, why, how, and when should I publish my unpublished data?

Many researchers have unpublished data. Some of this data may never be published as a manuscript. But I would like to make scholarly contributions of data that I have no intent on publishing, e.g. by ...
57
votes
7answers
3k views

Popular proprietary program or obscure open source substitute for reproducible research?

For a long time, I had been using open source software for my work to boost "reproducible research". I believed that if I made my codes open source and the softwares to run those codes in were open ...
26
votes
4answers
3k views

Why are papers accepted even if they don't release code or data to allow reproducibility?

Recently, we had a lecture about Reproducible research on of the slides was: Reproducibility: start from the same samples/data, use the same methods, get the same results. Replicability: ...
24
votes
2answers
2k views

As a reviewer, how much raw data or code should you request?

The topic of reproducible research is attracting quite some press these days, yet much remains to be done. In this spirit, I am asking what can be a reviewer's role in this — I'll explain fully below. ...
16
votes
2answers
483 views

I've reproduced a paper: where shall I share the code and findings?

The majority of papers don't share their code. However, I sometimes want to reproduce the results, and therefore re-code the experiments to try to reproduce the papers. Where shall I share the code, ...
3
votes
2answers
228 views

Incentives for independent researchers to work on reproducible research

For the sake of high-quality science diffusion, there is no doubt that reproducible research is a good practice as it helps to demonstrate the robustness of the proposed methods and boosts the ...
15
votes
3answers
1k views

Can you do a PhD solely on repeating experiments of others?

In here, they say there is a problem with results not being replicated. I know a PhD is supposed to be "original" research. But could you do a PhD solely on replicating the results of others? ...
6
votes
2answers
238 views

Is it beneficial for a student to publish their research code and data?

There are at least four benefits of releasing the code and data produced during a thesis or research project (citing textually this laboratory): Allows to reproduce figures in the revisions of a ...
6
votes
2answers
242 views

How to address an author showing replicated results from his paper?

I have replicated a method of interpolation recently proposed by certain author, and I want to tell him that I have done so. I suppose the author is interested in knowing that students are engaged ...