Hidden analyses: a review of reporting practice and recommendations for more transparent reporting of initial data analyses
Abstract
Background In the data pipeline from the data collection process to the planned statistical analyses, initial data analysis (IDA) typically takes place between the end of the data collection and do not touch the research questions. A systematic process for IDA and clear reporting of the findings would help to understand the potential shortcomings of a dataset, such as missing values, or subgroups with small sample sizes, or shortcomings in the collection process, and to evaluate the impact of these shortcomings on the research results. A clear reporting of findings is also relevant when making datasets available to other researchers. Initial data analyses can provide valuable insights into the suitability of a data set for a future research study. Our aim was to describe the practice of reporting of initial data analyses in observational studies in five highly ranked medical journals with focus on data cleaning, screening, and reporting of findings which led to a potential change in the analysis plan. Methods This review was carried out using systematic search strategies with eligibility criteria for articles to be reviewed. A total of 25 papers about observational studies were selected from five medical journals published in 2018. Each paper was reviewed by two reviewers and IDA statements were further discussed by all authors. The consensus was reported. Results IDA statements were reported in the methods, results, discussion, and supplement of papers. Ten out of 25 papers…
Read the paper
Related studies
- A Coupled SYSTEM of Intracellular Ca 2+ Clocks and Surface Membrane Voltage Clocks Controls the Timekeeping Mechanism of the Heart’s Pacemaker
- A Comprehensive Review on the Therapeutic Potential of Curcuma longa Linn. in Relation to its Major Active Constituent Curcumin
- Cancer epigenetics: Moving forward
- Current developments in LC-MS for pharmaceutical analysis
- Myricetin: A comprehensive review on its biological potentials
- A Computational Systems Biology Software Platform for Multiscale Modeling and Simulation: Integrating Whole-Body Physiology, Disease Biology, and Molecular Reaction Networks
Go deeper in Evidence Hub
Evidence Hub adds a study data sheet (design, sample size, evidence level, key numbers), an AI summary and a chat grounded in the paper's text.