GRADE guidelines: 4. Rating the quality of evidence - Study limitations (risk of bias)

Gordon H. Guyatt, Andrew D. Oxman, Gunn Vist, Regina Kunz, Jan Brozek, Pablo Alonso-Coello, Victor Montori, Elie A. Akl, Ben Djulbegovic, Yngve Falck-Ytter, Susan L. Norris, John W. Williams, David Atkins, Joerg Meerpohl, Holger J. Schünemann

Research output: Contribution to journalArticle

1191 Scopus citations

Abstract

In the GRADE approach, randomized trials start as high-quality evidence and observational studies as low-quality evidence, but both can be rated down if most of the relevant evidence comes from studies that suffer from a high risk of bias. Well-established limitations of randomized trials include failure to conceal allocation, failure to blind, loss to follow-up, and failure to appropriately consider the intention-to-treat principle. More recently recognized limitations include stopping early for apparent benefit and selective reporting of outcomes according to the results. Key limitations of observational studies include use of inappropriate controls and failure to adequately adjust for prognostic imbalance. Risk of bias may vary across outcomes (e.g., loss to follow-up may be far less for all-cause mortality than for quality of life), a consideration that many systematic reviews ignore. In deciding whether to rate down for risk of bias - whether for randomized trials or observational studies - authors should not take an approach that averages across studies. Rather, for any individual outcome, when there are some studies with a high risk, and some with a low risk of bias, they should consider including only the studies with a lower risk of bias.

Original languageEnglish (US)
Pages (from-to)407-415
Number of pages9
JournalJournal of Clinical Epidemiology
Volume64
Issue number4
DOIs
StatePublished - Apr 2011

Keywords

  • GRADE
  • blinding
  • concealment
  • confidence in estimates
  • quality of evidence
  • risk of bias

ASJC Scopus subject areas

  • Epidemiology

Fingerprint Dive into the research topics of 'GRADE guidelines: 4. Rating the quality of evidence - Study limitations (risk of bias)'. Together they form a unique fingerprint.

  • Cite this

    Guyatt, G. H., Oxman, A. D., Vist, G., Kunz, R., Brozek, J., Alonso-Coello, P., Montori, V., Akl, E. A., Djulbegovic, B., Falck-Ytter, Y., Norris, S. L., Williams, J. W., Atkins, D., Meerpohl, J., & Schünemann, H. J. (2011). GRADE guidelines: 4. Rating the quality of evidence - Study limitations (risk of bias). Journal of Clinical Epidemiology, 64(4), 407-415. https://doi.org/10.1016/j.jclinepi.2010.07.017