• Home

  • Blog

  • People

  • Contact us

  • More

    Reproducible research practice in health and medical research

    August 7, 2017

    |

    Joanna Diong

    Today's blog is from Joanna Diong. Jo is a faculty member at Sydney University where she investigates muscle activity (EMG) in motor control. She is passionate about good science and regularly co-authors the blog scientificallysound.org as a resource for people interested in doing research well.

     

    In the last few years, large replication studies in psychology, oncology and cancer biology have highlighted the inability to reproduce key scientific findings, and continue to fuel the debate on the reproducibility crisis in research. These findings, along with similar findings from other meta-research studies, have prompted researchers and scientists to look more closely at how research is done, and develop ways to improve the transparency and conduct of research. Fellow ICECReam’ers have written about related issues such as quality of clinical trials and limitations of p values. What are some ways that we, as a community of early career researchers, could implement reproducible research practices in our own research? Here are some strategies, adapted from a paper by Sandve and colleagues:

     

    1) For every result, keep track of how it was produced

     

    The development of a research question or testing protocol often goes through many iterations before it is finalised for a study. Especially during such a tortuous process, record the details of thought processes, rationale for testing procedures, and how pilot data were collected and analysed to obtain preliminary results. If you use a computer program to process and analyse data, record enough details on program settings, parameters and manual procedures so that in a year or so, your future self can reproduce the results.

     

    2) Avoid manual data manipulation steps

     

    Where possible, use an automated program (eg. programming scripts) instead of manual procedures (eg. clicking on drop-down boxes) to clean or analyse data. This is because such manual procedures are error-prone, inefficient, and difficult to reproduce.

     

    3) Version control programming scripts

     

    When writing a programming script to clean or analyse data, small changes can have large consequences, so record the versions of the script as it is being developed – this allows you to revert back to previous versions if needed. Ideally, use an automated version control system (eg. Git or Mercurial) to record versions of scripts. There are many free (online or face-to-face) courses to learn these programs.

     

    4) Provide public access to data, progamming scripts, and results

     

    Many journals are implementing measures to improve transparency in research. For example, the International Committee of Medical Journal Editors now require data sharing statements for publication of clinical trials, and the Journal of Physiotherapy encourages publishing code used to analyse the data. These measures are in keeping with principles of open science, with the aim of improving transparency and reproducibility in research.

     

     

    Reference

     

    Sandve GK, Nekrutenko A, Taylor J, Hovig E (2013) Ten Simple Rules for Reproducible Computational Research. PLoS Comput Biol 9(10): e1003285. https://doi.org/10.1371/journal.pcbi.1003285

    Please reload

    Our Recent Posts

    What are the main challenges PhD students face?

    October 23, 2019

    Is there such a thing as Clinician Researchers?

    September 6, 2019

    SPRiNG Social

    August 14, 2018

    Please reload

    Archive

    October 2019

    September 2019

    August 2018

    June 2018

    March 2018

    February 2018

    November 2017

    October 2017

    September 2017

    August 2017

    July 2017

    June 2017

    May 2017

    April 2017

    March 2017

    February 2017

    January 2017

    December 2016

    November 2016

    October 2016

    May 2016

    March 2016

    November 2015

    August 2015

    January 2015

    November 2014

    April 2014

    March 2014

    January 2014

    December 2013

    October 2013

    August 2013

    July 2013

    June 2013

    May 2013

    March 2013

    February 2013

    January 2013

    December 2012

    November 2012

    August 2012

    July 2012

    June 2012

    May 2012

    April 2012

    January 2012

    December 2011

    November 2011

    October 2011

    September 2011

    August 2011

    July 2011

    May 2011

    April 2011

    Please reload

    Tags

    Audience Engagement

    Blog

    Challenges

    Networking

    PhD

    Predatory conference

    SPRING

    SPRiNG Social

    blog

    career

    clinician

    coffee

    guruview

    love

    new

    researcher

    thoughts

    what's to like

    Please reload

    ©2018 BY THE INTERNATIONAL COLLABORATION OF EARLY CAREER RESEARCHERS (THE ICECREAM). PROUDLY CREATED WITH WIX.COM