Solve & Share
  • Home
  • Professional Projects
    • For You
    • For Families
    • For Free >
      • Free Books for Libraries
      • Free Magnets
      • Kitchen Scorecard
    • -------------
    • For School Lunches
    • For Workplace Wellness
    • For Grocery Shoppers
    • For Restaurant Lovers
  • About



​Academics
Only




​

"Does a Retracted Article Have False Findings?"

10/2/2018

 
Two years ago, I had no real idea what a "retracted" journal article was.  I had never thought of it, or known anyone who had had one.  If someone would have asked me, I would have probably said, "There must be something about it that was wrong."

Two years later, I've had a some journals ask me to rerun analyses and to show original paper-and-pencil surveys from as far back as 2000.  When we haven't been able to do so (didn't save the hard-copy surveys or can't track down the coauthor who did the analysis), some of the papers have been retracted because they can't be fully validated.  

Since then a few people have asked me if they can believe Article X or Y because  they were retracted.  I absolutely believe in these articles.  The general conclusions are the same, and even if the original hard-copy surveys and original analyses done a number of years ago can't be found, new reanalyses (often done with different statisticians) generate similar conclusions.

On Monday, one of my coauthors pointed out an insightful article that Dr. Stephen Holden had written for The Conversation website titled, "Retraction of a Journal Article Doesn't Make It's Findings False."  

One of his many points is that “Retractions may be important signals of reduced confidence in a finding, but they do not prove a finding false. This requires replication.”  Social science moves forward because of replication and not rereanalyses.
 
The Gold Standard of science is when independent researchers can run about the same study and come up with similar conclusions. This is why I wish I had published more detail in the method sections of some of my papers.  Instead, when the editor said “Cut out 1000 words,” we cut it out of the methodology section or the references and stayed focused on the idea.  Today, you can include all of the methodological detail and post on an online appendix if there isn’t room in the paper.  
 
Looking back, I’d also archive all of the analyses of my coauthors instead of assuming they’ll always have them on their computer or assuming they’ll never be needed.  Coauthors can lose laptops, change computers, or leave academia. 
 
As for saving the original pencil-and-paper copy of surveys and coding sheets . . . do so if you have your own warehouse (the photo above was taken in 2005 in Illinois in what was supposed to be my garage).  Otherwise you can collect it in a retrievable electronic form (if you think electronic collection won’t affect the results).
 
Academics is an incredibly enriching calling.  As you move forward in a happy career, I hope this is the only time you have to read about a retraction.
​
Picture
Photo by Bob Fila, Chicago Tribune (2005).

    Welcome...



    Fun, useful, or wacky experiences about getting tenure, teaching better, publishing more, and having an incredibly rewarding career.


      What'd be Useful?

    Got it

    Picture


    Categories

    All
    For Graduate Students
    For Independent Scholars
    For Junior Faculty


    RSS Feed


    Some Blog Shortcuts

    Picture
    Develop great judgment
    Picture
    Give useful advice
    Picture
    How not to retire
    Picture
    Get things done
    Picture
    Have students over
    Picture
    Get into a PhD Program
    Picture
    How to write a lot
    Picture
    Useful sample syllabus
    Picture
    Horrible teacher lessons
    Picture
    Use PhD case studies
    Picture
    Show gratitude
    Picture
    Blow an interview
    Picture
    Solution-focused research
    Picture
    Ace a conference interview
    Picture
    Be a legendary teacher
    Picture
    Mentor & be mentored
    Picture
    Call and be happy

    Archives

    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    September 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018

Home

For You

For Families

For School Lunches


    Sign up for updates and for upcoming chapters of a new book and memoir

Keep me posted
Copyright © 2025
  • Home
  • Professional Projects
    • For You
    • For Families
    • For Free >
      • Free Books for Libraries
      • Free Magnets
      • Kitchen Scorecard
    • -------------
    • For School Lunches
    • For Workplace Wellness
    • For Grocery Shoppers
    • For Restaurant Lovers
  • About