Kdtyjb

A flower in a hexagon

PGF Plot settings

On what did Lego base the appearance of the new Hogwarts minifigs?

A starship is travelling at 0.9c and collides with a small rock. Will it leave a clean hole through, or will more happen?

Why didn't Eru and/or the Valar intervene when Sauron corrupted Númenor?

What do you call a fact that doesn't match the settings?

Why are the books in the Game of Thrones citadel library shelved spine inwards?

Called into a meeting and told we are being made redundant (laid off) and "not to share outside". Can I tell my partner?

How do you funnel food off a cutting board?

1 0 1 0 1 0 1 0 1 0 1

Why did Bush enact a completely different foreign policy to that which he espoused during the 2000 Presidential election campaign?

Cat is tipping over bed-side lamps during the night

Why do neural networks need so many training examples to perform?

Is there any differences between “gucken” and “schauen”?

Program that converts a number to a letter of the alphabet

Inferring from (∃x)Fx to (∃x)(∃x)Fx using existential generalization?

Does Windows 10's telemetry include sending *.doc files if Word crashed?

How can I improve my fireworks photography?

Everyone is beautiful

High pressure canisters of air as gun-less projectiles

Do authors have to be politically correct in article-writing?

How to deal with an incendiary email that was recalled

I am on the US no-fly list. What can I do in order to be allowed on flights which go through US airspace?

Eww, those bytes are gross

What to do if authors don't respond to my serious concerns about their paper?

Discovered a serious error in a reviewed paper after submitting the review, what to do?Should I warn my professor about some errors that I've found in his paper?Found errors in paper: What happens now?What to do about accidental, easily corrected errors in a conference paper you already submitted?What to do about an important typo mistake in my submitted conference paper?Will I destroy my career if I published a paper with a serious mistake?Fixed an error in my published paper, and cite the paper in my not-yet-defended thesis. What should I do?What should I do if a paper makes false claims about my work?Serious error in published journal paper by a faculty memberWhat to do if a paper by respected authors has obvious problems, and I have told them so already?

20

4

I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.

As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.

The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.

I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.

A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:

1. Send the authors a follow-up email. (If so, what should I say to get the message across?)


2. Contact the journal with my concerns.


3. Write a response. (Would such a thing get published?)


4. Do nothing. (I think the paper is too important.)

errors-erratum

share|improve this question

asked yesterday

ThomasThomas

14.1k63053

• 
  
  
  

  
  11
  

  
  
  
  
  
  

  
  
  You haven’t mentioned whether you’ve asked anyone to double-check your thoughts. I’d do that first. Then academia.stackexchange.com/a/125807/11870
  
  – Ryan
  19 hours ago
  

  
  
  
  


• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  @Ryan Yes, I got a colleague to read the paper and my email to check that I wasn’t missing something obvious.
  
  – Thomas
  17 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  4
  

  
  
  
  
  
  

  
  
  Do you believe this could be a case of scientific misconduct/fraud or just a honest mistake (that collides with your data/views)? I believe each of these issues require a completely different approach.
  
  – Quora Feans
  16 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  @QuoraFeans It must be an honest mistake.
  
  – Thomas
  15 hours ago
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  What is your interest in this subject? Are you a professional yourself?
  
  – Bernhard Döbler
  11 hours ago
  

  
  
  
  

 | 
show 1 more comment

20

4

I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.

As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.

The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.

I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.

A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:

1. Send the authors a follow-up email. (If so, what should I say to get the message across?)


2. Contact the journal with my concerns.


3. Write a response. (Would such a thing get published?)


4. Do nothing. (I think the paper is too important.)

errors-erratum

share|improve this question

asked yesterday

ThomasThomas

14.1k63053

• 
  
  
  

  
  11
  

  
  
  
  
  
  

  
  
  You haven’t mentioned whether you’ve asked anyone to double-check your thoughts. I’d do that first. Then academia.stackexchange.com/a/125807/11870
  
  – Ryan
  19 hours ago
  

  
  
  
  


• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  @Ryan Yes, I got a colleague to read the paper and my email to check that I wasn’t missing something obvious.
  
  – Thomas
  17 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  4
  

  
  
  
  
  
  

  
  
  Do you believe this could be a case of scientific misconduct/fraud or just a honest mistake (that collides with your data/views)? I believe each of these issues require a completely different approach.
  
  – Quora Feans
  16 hours ago
  
  
  

  
  
  
  


• 
  
  
  

  
  2
  

  
  
  
  
  
  

  
  
  @QuoraFeans It must be an honest mistake.
  
  – Thomas
  15 hours ago
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  What is your interest in this subject? Are you a professional yourself?
  
  – Bernhard Döbler
  11 hours ago
  

  
  
  
  

 | 
show 1 more comment

I recently read a paper that conducted an experiment, analyzed it, and reached a conclusion. However, the way they conducted the analysis is seriously flawed and cannot be used to support the conclusion.

As far as I can tell, the experiment is valid and only the analysis is problematic. Thus the paper can be rewritten, although the conclusion may completely change.

The paper is published in a highly-reputable and prestigious scientific journal. The authors are all senior researchers at reputable institutions.
It's a bit of a surprise that this flaw got past the authors and peer review. I suspect that, because the conclusion confirms what many people already believe, the analysis was not scrutinized too closely. I only became suspicious of it because the measured effect was too strong. The analysis is also reasonably complex and the flaw is somewhat subtle.

I contacted all three authors by email and explained the problem with their analysis. I did by best to phrase the email appropriately.

A month later, I have received no response to my email. What would be a reasonable course for further action? Options include:

1. Send the authors a follow-up email. (If so, what should I say to get the message across?)


2. Contact the journal with my concerns.


3. Write a response. (Would such a thing get published?)


4. Do nothing. (I think the paper is too important.)

errors-erratum

share|improve this question

asked yesterday

ThomasThomas

14.1k63053

share|improve this question

asked yesterday

ThomasThomas

14.1k63053

share|improve this question

asked yesterday

ThomasThomas

14.1k63053

asked yesterday

ThomasThomas

14.1k63053

asked yesterday

ThomasThomas

14.1k63053

3 Answers
3

active

oldest

votes

34

3. Write a response. (Would such a thing get published?)

This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).

As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.

share|improve this answer

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  I suggest you to consider also the answer by guest as for a comment is indeed harder avenue.
  
  – Alchimista
  19 hours ago
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Or just publish a paper pointing out the flaw in the analysis and making clear what can and cannot be concluded from the experiment. If the original paper is in a high profile journal you might not get into the same one, but even publishing in a different journal would be worthwhile. This is really the best outcome - readers get to know the flaws in the original analysis, and you get the credit for pointing them out.
  
  – Nathaniel
  5 hours ago
  

  
  
  
  

add a comment | 

10

There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.

1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/




2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).

share|improve this answer

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  6
  

  
  
  
  
  
  

  
  
  I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.
  
  – Thomas
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.
  
  – guest
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  I'm not really sure comparing scientific, peer-reviewed literature being wrong to someone on the internet being wrong is the best analogy here. I think it's pretty upstanding to worry about a scientific paper being incorrect (and part of what science, in general, is all about).
  
  – AmagicalFishy
  17 hours ago
  
  
  

  
  
  
  

add a comment | 

2

By analysis do you mean statistics/informatics?

Could you possibly do the analysis correctly and submit it as a response. The conclusion might be the same, but it should still be sorted out.

share|improve this answer

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  This does not provide an answer to the question. Once you have sufficient reputation you will be able to comment on any post; instead, provide answers that don't require clarification from the asker. - From Review
  
  – FuzzyLeapfrog
  18 hours ago
  

  
  
  
  

add a comment | 

Your Answer

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "415"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2facademia.stackexchange.com%2fquestions%2f125806%2fwhat-to-do-if-authors-dont-respond-to-my-serious-concerns-about-their-paper%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

34

3. Write a response. (Would such a thing get published?)

This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).

As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.

share|improve this answer

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  I suggest you to consider also the answer by guest as for a comment is indeed harder avenue.
  
  – Alchimista
  19 hours ago
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Or just publish a paper pointing out the flaw in the analysis and making clear what can and cannot be concluded from the experiment. If the original paper is in a high profile journal you might not get into the same one, but even publishing in a different journal would be worthwhile. This is really the best outcome - readers get to know the flaws in the original analysis, and you get the credit for pointing them out.
  
  – Nathaniel
  5 hours ago
  

  
  
  
  

add a comment | 

34

3. Write a response. (Would such a thing get published?)

This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).

As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.

share|improve this answer

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  I suggest you to consider also the answer by guest as for a comment is indeed harder avenue.
  
  – Alchimista
  19 hours ago
  

  
  
  
  


• 
  
  
  

  
  

  
  
  
  
  
  

  
  
  Or just publish a paper pointing out the flaw in the analysis and making clear what can and cannot be concluded from the experiment. If the original paper is in a high profile journal you might not get into the same one, but even publishing in a different journal would be worthwhile. This is really the best outcome - readers get to know the flaws in the original analysis, and you get the credit for pointing them out.
  
  – Nathaniel
  5 hours ago
  

  
  
  
  

add a comment | 

3. Write a response. (Would such a thing get published?)

This. Such things are usually titled "Comment to..." and, yes, they are published, typically alongside with a reply from the authors of the commented paper (the comment is usually sent to them by the journal editor).

As usual disclaimer, since things may vary across fields and journals, check if the journal in question has already published comments of this type and, in doubt, contact the editor.

share|improve this answer

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

share|improve this answer

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

answered yesterday

Massimo OrtolanoMassimo Ortolano

39.4k12119148

10

There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.

1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/




2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).

share|improve this answer

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  6
  

  
  
  
  
  
  

  
  
  I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.
  
  – Thomas
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.
  
  – guest
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  I'm not really sure comparing scientific, peer-reviewed literature being wrong to someone on the internet being wrong is the best analogy here. I think it's pretty upstanding to worry about a scientific paper being incorrect (and part of what science, in general, is all about).
  
  – AmagicalFishy
  17 hours ago
  
  
  

  
  
  
  

add a comment | 

10

There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.

1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/




2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).

share|improve this answer

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  6
  

  
  
  
  
  
  

  
  
  I don’t lose sleep about bogus papers at third-tier publication venues, because no one will ever read them. But this is different.
  
  – Thomas
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  Science/Nature have a worse record than ACS journals in my experience. They chase a lot of hype science.
  
  – guest
  yesterday
  

  
  
  
  


• 
  
  
  

  
  5
  

  
  
  
  
  
  

  
  
  I'm not really sure comparing scientific, peer-reviewed literature being wrong to someone on the internet being wrong is the best analogy here. I think it's pretty upstanding to worry about a scientific paper being incorrect (and part of what science, in general, is all about).
  
  – AmagicalFishy
  17 hours ago
  
  
  

  
  
  
  

add a comment | 

There are about a gazillion papers with problems with them. And authors who don't want to fix them, don't think they're wrong, whatever.

1. Just resign yourself to the imperfection of the published literature. Really, killing yourself with worry that there is a science paper with a mistake in it is like the XKCD cartoon about "someone is wrong on the Internet". https://xkcd.com/386/




2. Failing that, write a paper of your own to correct/dispute the issue. Either a direct comment/critique (harder avenue). Or a paper with some new contribution but that allows revisiting the work of the other group and dissing it en passant (easier avenue).

share|improve this answer

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this answer

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered yesterday

guestguest

2214

New contributor

guest is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered yesterday

guestguest

2214

2

By analysis do you mean statistics/informatics?

Could you possibly do the analysis correctly and submit it as a response. The conclusion might be the same, but it should still be sorted out.

share|improve this answer

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  This does not provide an answer to the question. Once you have sufficient reputation you will be able to comment on any post; instead, provide answers that don't require clarification from the asker. - From Review
  
  – FuzzyLeapfrog
  18 hours ago
  

  
  
  
  

add a comment | 

2

By analysis do you mean statistics/informatics?

Could you possibly do the analysis correctly and submit it as a response. The conclusion might be the same, but it should still be sorted out.

share|improve this answer

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  
  This does not provide an answer to the question. Once you have sufficient reputation you will be able to comment on any post; instead, provide answers that don't require clarification from the asker. - From Review
  
  – FuzzyLeapfrog
  18 hours ago
  

  
  
  
  

add a comment | 

By analysis do you mean statistics/informatics?

Could you possibly do the analysis correctly and submit it as a response. The conclusion might be the same, but it should still be sorted out.

share|improve this answer

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

share|improve this answer

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 19 hours ago

JonoJono

591

New contributor

Jono is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

answered 19 hours ago

JonoJono

591