Questions related to the reproducibility of research findings.

learn more… | top users | synonyms

4
votes
1answer
176 views

Can I request the code behind a research paper from the author?

I am in the field of computer science. It is often the case when I am reading a paper I start to wonder, "Wow stunning results, however I would like to proof that" or "How did he exactly got these ...
8
votes
5answers
182 views

Are there any proposals to make sharing code and data with publications a requirement?

Depending on the project, many researchers have to rewrite code and reproduce datasets from previous works in order to perform experimental evaluations. Although some dataset are understood to contain ...
16
votes
3answers
987 views

What should I do if I cannot reproduce experimental published results

I found a useful advice if I cannot reproduce computational published results in (What should you do if you cannot reproduce published results?). However I would like to ask the same situation with ...
2
votes
1answer
78 views

Forum for discussing research paper

I am trying to implement an algorithm given in a paper. I have some questions which I would like to clear out since implementation requires complete clarity on all the concepts/algorithms/arguments ...
14
votes
6answers
748 views

Licence that converts to GPL after publication but is copyrighted prior to publication

I would like to post an repository on github that includes data and analysis code in R. The analysis and data forms part of a journal article submission. I'm happy for people to view the code and data ...
13
votes
2answers
400 views

As a reviewer, how much raw data or code should you request?

The topic of reproducible research is attracting quite some press these days, yet much remains to be done. In this spirit, I am asking what can be a reviewer's role in this — I'll explain fully below. ...
9
votes
2answers
451 views

How does a PhD student go about doing a meta analysis of a research question?

I just thought that I would put this question out here because I am currently working on a meta analysis of a particular research question in my field (HCI/information science). Moreover, this ...
16
votes
3answers
197 views

How to replicate others' results quickly?

Lately, I've been getting the impression that before I can conduct cutting edge research, I have to first master state of the art methods/techniques. Often, this requires spending (i.e. wasting) lots ...
13
votes
5answers
497 views

Has it ever happened that one paper's findings were contradicted by another?

Since reviewers don't check the experimental results by trying to reproduce the experiment, is it possible for someone to submit a paper which basically says "Method X was proposed in paper Y and ...
46
votes
8answers
2k views

What should you do if you cannot reproduce published results?

I am trying to reproduce published results in a paper. Those results come from numerical simulations. The original authors and I do not use the same software, and theirs is proprietary (I don't have ...
24
votes
6answers
622 views

Reproducible Research :: Proprietary or Open Source Software?

For a long time, I had been using open source software for my work to boost "reproducible research". I believed that if I made my codes open source and the softwares to run those codes in were open ...
27
votes
3answers
934 views

Requesting raw data from previously published research

I am working on a mathematical model to help explain some experimental results and generate new hypotheses. Unfortunately, I have neither the resources nor interest to gather experimental data, but in ...
8
votes
1answer
201 views

How long should I register a domain name that will be referenced in scientific publications?

I have a website (with data and modeling interface) that will be referenced in a series of scientific publications that are beginning to be published. Currently the website is along the lines of ...
24
votes
5answers
545 views

Data publication basics - where, why, how, and when should I publish my unpublished data?

Many researchers have unpublished data. Some of this data may never be published as a manuscript. But I would like to make scholarly contributions of data that I have no intent on publishing, e.g. by ...
21
votes
3answers
285 views

How to get the data to reproduce a published result?

I'm studying published journal articles on my topic, and I'd like to reproduce their analysis. How can I get a copy of their dataset and enough specifications to reproduce their numerical results? ...