What is the proper action when peers in your field have/are publishing papers with a crucial flaw?

Question

I am in an uncomfortable position. I am beginning to do research in a particular area within my field. The body of related works are mostly done by students of a single professor. And, nearly all of it makes a crucial mistake. The works are borrowing/applying concepts and techniques from other, more theoretical and mathematical fields, yet in a way that doesn't make logical sense. Specifically, they are conflating terms, utilizing them as good sounding buzzwords, and (through an incorrect interpretation) as a criterion for the design and value of their techniques.

My work heavily uses the same concepts, yet my arguments are completely contradictory to those of my peers. So I am trying to figure out the best course of action.

I could start by submitting a paper correcting their mistakes, but it would feel a little cruel, and would likely turn my peers against me. I could publish my works, and try to point out their flaws politely, but the flaws are so prevalent that it would still likely cause a lot of discomfort to them. I could send an email to them explaining the problems with their work, but I'm not sure how that would go. It's quite a problem, because it really invalidates the reasoning and conclusions of dozens of papers and even a text book. The professor is distinguished and well known in his field. I really don't want to be the one to stir things up, but the issue must be addressed in some way or another in order for me to publish my work.

Answer 1

This may seem like a cliched answer, but I believe good communication would be key. First off, you need to make absolute sure about whether or not their work represents flaws (preferably with your supervisor). The next step I believe you should take is to contact the Professor whose team you believe has made such critical mistakes. Discuss the issue with them and get their perspective. If, after all of these efforts, you are still absolutely sure that there is a mistake in their work, politely inform them that you disagree with their approach/methods/technique/etc. and that you will be publishing a paper representing a different point of view and approach that presents your argument on the matter. Mind you, don't ask their permission, it's merely a courtesy so as to show that you don't mean anything personal by it. After that, publish away.

Finally, I should mention that I feel that there isn't really any issue at all. If someone got mad at me for publishing a paper that disagreed with their research...that's not exactly a person I would care if they were mad at me or not. It not only seems excessively petty, but it's also the nature of scientific research. Great ideas and solid theories get overturned and refuted on a regular basis. If your counterpoint to their research is solid enough to be published in a good journal, then it's good enough for them to read and consider without getting unnecessarily angry.

Answer 2

I recently read a paper that I think does something quite similar to what you're thinking about. You can access it here: https://physics.nyu.edu/sokal/complex_dynamics_final_clean.pdf but here is a citation for posterity:

Brown, N.J., Sokal, A.D., & Friedman, H.L., (2013). The complex dynamics of wishful thinking: The critical positivity ratio. American Psychologist, 68, 801-813.

This is a case in which a psychological theory was built upon some concepts taken from other fields and the authors here argue they were both wrong to do so and at any rate seem to have made key errors in their applications of those concepts. To be clear, this example is pretty much scorched Earth; the critics are not pulling any punches or trying to make anyone feel better. Of course, you have to remember that anything you say will be read against the literature that came before it, so you need to make a strong case.

What I think is done well here is:

• Make clear what exactly is wrong and what the implications are for the research area.
• Be absolutely certain about the correctness of the criticism and painstakingly explain it so non-experts have a chance to evaluate your new claim. Chances are, the error(s) has gone uncorrected due in part to others not knowing enough to notice it.
• Discussing a potentially correct use of the concept (this could be where your research comes in).

I should also note that the lead author of that paper was a graduate student in psychology who somehow connected with the second author, an eminent scholar in mathematics and physics. It's also clear from the author note that the author(s) reached out to several other highly-qualified researchers to solicit feedback. One lesson here is it is helpful to get powerful allies, who are often going to be people who don't have a dog in the fight (but could be people who always disbelieved the research you're criticizing). Another is that it pays to be really, really sure you're correct.

In this case, the lead researcher behind the criticized theory responded and gave substantial ground to the critics (link to gated article), saying she was not qualified to dispute the critics' claims and felt the gist of the theory was correct but clearly the mathematical side was not. I wouldn't be so optimistic about the original researcher conceding a whole lot in your case, but it's a good example of how an argument can be presented so convincingly that everyone involved finds a measure of agreement.

Answer 3

Can't you just explain why they are wrong in your own published work? Maybe just discuss it with them beforehand and explain your arguments so they don't see it as a personal attack when they see you criticising them and attacking their arguments.

There are some well-known articles in physics which are entirely based around ''X has argued this, his arguments are completely wrong, here is why'', but it's done in a polite and rational way.