Do trials reduce uncertainty? Assessing impact through cumulative meta-Analysis of neonatal RCTs

S. C. Hay, H. Kirpalani, C. Viner, R. Soll, Dmitry Dukhovny, W. Y. Mao, J. Profit, S. B. DeMauro, J. A.F. Zupancic

Research output: Contribution to journalArticle

5 Scopus citations

Abstract

Objective:To assess the impact of the latest randomized controlled trial (RCT) to each systematic review (SR) in Cochrane Neonatal Reviews.Study Design:We selected meta-Analyses reporting the typical point estimate of the risk ratio for the primary outcome of the latest study (n=130), mortality (n=128) and the mean difference for the primary outcome (n=44). We employed cumulative meta-Analysis to determine the typical estimate after each trial was added, and then performed multivariable logistic regression to determine factors predictive of study impact.Results:For the stated primary outcome, 18% of latest RCTs failed to narrow the confidence interval (CI), and 55% failed to decrease the CI by ≥20%. Only 8% changed the typical estimate directionality, and 11% caused a change to or from significance. Latest RCTs did not change the typical estimate in 18% of cases, and only 41% changed the typical estimate by at least 10%. The ability to narrow the CI by >20% was negatively associated with the number of previously published RCTs (odds ratio 0.707). Similar results were found in analysis of typical estimates for the outcomes of mortality and mean difference.Conclusion:Across a broad range of clinical questions, the latest RCT failed to substantially narrow the CI of the typical estimate, to move the effect estimate or to change its statistical significance in a majority of cases. Investigators and grant peer review committees should consider prioritizing less-studied topics or requiring formal consideration of optimal information size based on extant evidence in power calculations.

Original languageEnglish (US)
Pages (from-to)1215-1219
Number of pages5
JournalJournal of Perinatology
Volume37
Issue number11
DOIs
StatePublished - Nov 1 2017

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health
  • Obstetrics and Gynecology

Fingerprint Dive into the research topics of 'Do trials reduce uncertainty? Assessing impact through cumulative meta-Analysis of neonatal RCTs'. Together they form a unique fingerprint.

  • Cite this

    Hay, S. C., Kirpalani, H., Viner, C., Soll, R., Dukhovny, D., Mao, W. Y., Profit, J., DeMauro, S. B., & Zupancic, J. A. F. (2017). Do trials reduce uncertainty? Assessing impact through cumulative meta-Analysis of neonatal RCTs. Journal of Perinatology, 37(11), 1215-1219. https://doi.org/10.1038/jp.2017.126