TY - JOUR
T1 - Improving grading of recommendations assessment, development, and evaluation evidence tables part 4
T2 - a three-arm noninferiority randomized trial demonstrates improved understanding of content in summary of findings tables with a new format
AU - Morgan, Rebecca L.
AU - Yepes-Nuñez, Juan José
AU - Ewusie, Joycelyne
AU - Mbuagbaw, Lawrence
AU - Chang, Stephanie
AU - Baldeh, Tejan
AU - Hempel, Susanne
AU - Helfand, Mark
AU - Shekelle, Paul
AU - Wilt, Timothy J.
AU - Schünemann, Holger J.
N1 - Funding Information:
We would like to acknowledge Alonso Carrasco-Labra, Carlos Cuello-Garcia, Yngve Falck-Ytter, M. Hassan Murad, Reem Mustafa, Nancy Santesso, Wojtek Wiercioch, and Yuan Zhang for reviewing and proving suggestions during the development of the alternative GRADE SoF table.
Publisher Copyright:
© 2022 Elsevier Inc.
PY - 2023/2
Y1 - 2023/2
N2 - Objectives: To evaluate alternative formats of summary of findings (SoF) tables for single comparison with multiple outcomes. Study Design and Setting: We conducted a three-arm randomized controlled noninferiority trial (RCT) in the following systematic review (SR) users: researchers, clinical practice guideline developers, health care providers, policymakers, and knowledge transfer organizations to measure understanding, accessibility, satisfaction, and preference across the current grading of recommendations assessment, development, and evaluation (GRADE) SoF, an alternative GRADE SoF, or an adapted evidence-based practice center (EPC) program SoF table. Results: One Hundred Seventy-Nine participants were randomized, and 129 participants completed the RCT (n = 47 current GRADE, n = 41 alternative GRADE, n = 41 adapted EPC). Understanding the certainty of evidence and treatment effect was comparable across groups. The adapted EPC SoF table was inferior for quantifying risk and RD compared to the alternatives (<35% correct vs. >85% correct). Participants reported increased satisfaction when SoF tables presented number needed to treat (NNT), anticipated absolute effect differences, and narrative syntheses for evidence that could not be meta-analyzed. Participants reported accessibility to information as significantly better in both GRADE SoF tables, when compared with the adapted EPC SoF table. Participants preferred the alternative GRADE SoF table format. Conclusion: The alternative GRADE SoF table is a promising format for SR users preferring a comprehensive presentation of SR results for single comparisons.
AB - Objectives: To evaluate alternative formats of summary of findings (SoF) tables for single comparison with multiple outcomes. Study Design and Setting: We conducted a three-arm randomized controlled noninferiority trial (RCT) in the following systematic review (SR) users: researchers, clinical practice guideline developers, health care providers, policymakers, and knowledge transfer organizations to measure understanding, accessibility, satisfaction, and preference across the current grading of recommendations assessment, development, and evaluation (GRADE) SoF, an alternative GRADE SoF, or an adapted evidence-based practice center (EPC) program SoF table. Results: One Hundred Seventy-Nine participants were randomized, and 129 participants completed the RCT (n = 47 current GRADE, n = 41 alternative GRADE, n = 41 adapted EPC). Understanding the certainty of evidence and treatment effect was comparable across groups. The adapted EPC SoF table was inferior for quantifying risk and RD compared to the alternatives (<35% correct vs. >85% correct). Participants reported increased satisfaction when SoF tables presented number needed to treat (NNT), anticipated absolute effect differences, and narrative syntheses for evidence that could not be meta-analyzed. Participants reported accessibility to information as significantly better in both GRADE SoF tables, when compared with the adapted EPC SoF table. Participants preferred the alternative GRADE SoF table format. Conclusion: The alternative GRADE SoF table is a promising format for SR users preferring a comprehensive presentation of SR results for single comparisons.
KW - Evidence summaries
KW - GRADE
KW - Guideline development
KW - Randomized controlled noninferiority trial
KW - Summary of findings table
KW - Systematic reviews
UR - http://www.scopus.com/inward/record.url?scp=85146435040&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85146435040&partnerID=8YFLogxK
U2 - 10.1016/j.jclinepi.2022.12.001
DO - 10.1016/j.jclinepi.2022.12.001
M3 - Article
C2 - 36503004
AN - SCOPUS:85146435040
SN - 0895-4356
VL - 154
SP - 125
EP - 135
JO - Journal of Chronic Diseases
JF - Journal of Chronic Diseases
ER -