Take the 2-minute tour ×
Academia Stack Exchange is a question and answer site for academics and those enrolled in higher education. It's 100% free, no registration required.

I am a postdoc working in a lab where we are finishing a large project with multiple measures (psychological, behavioral, etc). Some of the measures didn't turn out to have significant results (primarily for methodological reasons I believe). I suggested to the Lead Investigator that we write up some of these as "we tried these measures and didn't get the results we expected for various reasons: here are some lessons we have learned". The reply was:

My immediate response is not all that positive – especially if it undermined our published papers ... if you’ve published a result then further publications shouldn’t raise more limitations that should have been mentioned in the original publication.

I don't believe the results will undermine anything but, that aside, is his reasoning for not publishing results valid? Also, to be clear, we haven't yet published anything from this work.

I understand him to mean that he doesn't want the results published because they might go against previous work and completely object to such a thought. Have I possibly misinterpreted his words?

share|improve this question
    
@PeteL.Clark I think the results are negative because we were doing something novel and some measures weren't as discriminatory as we might have expected. There is also an issue of recruitment for one of the measures. All very logical and reasonable explanations and, I think, good lessons for others wishing to do similar work. –  Eddie Sanders Jun 7 at 7:15
    
I agree that negative results are a "hard sell" for many journals. I was completely prepared for a response along the lines of "No, I don't think the effort of an article is worth it; perhaps we should look at a conference abstract or publishing the results with others to tell a story". What I feel I got was "No, we shouldn't publish this because it might not look good" - or have I misinterpreted things? –  Eddie Sanders Jun 7 at 7:17
    
I put the above comments as the first two paragraphs of an answer and went on to address your second comment. (Short answer to your question: your less charitable interpretation seems reasonable, unfortunately.) –  Pete L. Clark Jun 7 at 7:19
7  
If you simply don't understand what someone means in an email they send you, asking other people who don't know nearly as much about the situation as you do doesn't seem likely to lead to a satisfactory answer. If ever there was an email to motivate you to pay your Lead Investigator an in-person visit, this is it. I understand that you probably can't do this until Monday at the earliest, but until then I would advise you to just stop worrying about it and do something more pleasant and/or more productive. –  Pete L. Clark Jun 7 at 7:42
1  
Here is an interesting piece from the Economist which highlights the problems with the general reluctance to publish negative results: economist.com/news/briefing/… –  Mark Meckes Jun 8 at 7:48

2 Answers 2

up vote 12 down vote accepted

The statement you quote sounds terrible. It points in a direction where things approach the unethical. Publication of negative results are less common that positive although, I suspect, negative results ARE more common than positive. Since I am in an experimental field, I have never obtained the perfect results and always end up describing what went wrong; and I am not alone. Anyway, I think your idea of writing up your experience is good. Naturally, I cannot judge the merits of the experiences in terms of publicability.

So I think your intention is very sound and the reaction of the lead investigator suspect (or at best narrow-minded).

To me " further publications shouldn’t raise more limitations that should have been mentioned in the original publication" (if verbatim from the lead investigator and with my emphasis) sounds as if limitations were not included on purpose in the original study. So, if that is true then I can understand the nervousness. It sounds almost fraudulent.

share|improve this answer
    
+1: Especially, your last paragraph addresses something that I hinted at in the distinction between errors and limitations, but you've hit it right on the head. If the LI feels that the OP knew about the limitations at the time of the original paper, then he would have every right to be upset. However from the OP's post it sounds like this was not the case. Possibly there is some miscommunication here. –  Pete L. Clark Jun 7 at 7:17
    
Thanks @Peter.Jansson, those were his words verbatim from an email so hard to know emphasis. We haven't published from this work yet and I am relatively new to the group so it's hard to know exactly what previous work he's referring to. –  Eddie Sanders Jun 7 at 7:28
4  
In verbatim, this interpretation is correct. However, in mailing between colleagues, people do not always mean exactly what they say, so let's not get all witch-hunty too quickly. The PI may very reasonably also mean that publishing a "see what unsuccessful thing we did" paper may undermine the reputation of the group (and hence question previous publications). –  xLeitix Jun 7 at 15:59
1  
@xLeitix I understand the foibles of email. Thank you for another perspective. Could I ask you to please clarify your position, please. I still see that not wanting to publish for fear of questioning previous publications is wrong. I was clear in my proposal to him that we publish a "what we tried that didn't work as expected: here are the lessons" paper. –  Eddie Sanders Jun 9 at 8:23
    
@EddieSanders My main point is that I don't have a "position". I think it is wrong to jump to any sort of conclusion based on an excerpt from a private email convo. Go talk to your PI in person, and things will become clearer. –  xLeitix Jun 9 at 8:35

If I understand you correctly, what you want to publish doesn't "go against" the previous work. It's fully consistent with it, but what is being added is what are often called negative results: namely, the discovery that a certain plausible method or established theory cannot be used in a certain manner to solve a certain problem.

In every branch of academia I know of, it is -- unfortunately -- very difficult to publish negative results. In the abstract, most people agree that this is a shame: convincingly arguing that researchers should not go down a certain path is obviously a service to the community. However, in a competitive publication system negative results are somehow not very, um, competitive. So trying to publish these results may not be the best use of your time unless you package them carefully -- very crudely, you will probably need to bundle them with "positive results".

The above is a relatively benign interpretation of your Lead Investigator's comments. It is alas also possible that he is saying that you should not try to publish your negative results because that information will reduce the prestige of your previously published paper. I agree that this sounds ethically dubious, yes, but depending on the field it is not clear that you are ethically required to publish further work explaining the limitations of your previous results. Here I would make a distinct between limitations and errors: errors are things that you should have known better than to include in the original version, and in many fields it is appropriate to print a retraction, erratum or corrigendum when you learn about them. On the other hand, that a publication contains ideas that are not completely definitive and whose future value is the subject of informed speculation....well, that's how research works.

I would say that the ethical issues become more acute depending upon the reaction that your published paper has received. If your paper has been very influential to researchers and is causing them to spend a lot of time exploring what you know to be a blind alley, then formal publication or no, it seems ethical to relate this information to them. If your publication has present nonacademic ramifications -- e.g. if you are in some kind of bio-medical field and your publication has resulted in patient protocols that you know to be suboptimal -- then you should be thinking about how to get the word out ASAP.

Anyway, it sounds like you need to have a conversation with your Lead Investigator about this. Find out what he meant and why.

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.