Early warning system scores for clinical deterioration in hospitalized patients

A systematic review

M. E Beth Smith, Joseph Chiovaro, Maya O'Neil, Devan Kansagara, Ana Quinones, Michele Freeman, Makalapua L. Motu'apuaka, Christopher G. Slatore

Research output: Contribution to journalArticle

81 Citations (Scopus)

Abstract

Rationale: Early warning system (EWS) scores are used by hospital care teams to recognize early signs of clinical deterioration and trigger more intensive care.

Objective: To systematically review the evidence on the ability of early warning system scores to predict a patient's risk of clinical deterioration and the impact of early warning system implementation on health outcomes and resource utilization.

Methods: We searched the MEDLINE, CINAHL, and Cochrane Central Register of Controlled Trials databases through May 2014. We included English-language studies of early warning system scores used with adults admitted to medical or surgical wards. We abstracted study characteristics, including population, setting, sample size, duration, and criteria used for early warning system scoring. For predictive ability, the primary outcomes were modeled for discrimination on 48-hour mortality, cardiac arrest, or pulmonary arrest. Outcomes for the impact of early warning system implementation included 30-day mortality, cardiovascular events, use of vasopressors, respiratory failure, days on ventilator, and resource utilization. We assessed study quality using a modified Quality in Prognosis Studies assessment tool where applicable.

Measurements and Main Results: Of 11,183 citations studies reviewed, one controlled trial and 20 observational studies of 13 unique models met our inclusion criteria. In eight studies, researchers addressed the predictive ability of early warning system tools and found a strong predictive value for death (area under the receiver operating characteristic curve [AUROC], 0.88-0.93) and cardiac arrest (AUROC, 0.74-0.86) within 48 hours. In 13 studies (one controlled trial and 12 pre-post observational studies), researchers addressed the impact on health outcomes and resource utilization and had mixed results. The one controlled trial was of good quality, and the researchers found no difference in mortality, transfers to the ICU, or length of hospital stay. The pre-post designs of the remaining studies have significant methodological limitations, resulting in insufficient evidence to draw conclusions.

Conclusions: Early warning system scores perform well for prediction of cardiac arrest and death within 48 hours, although the impact on health outcomes and resource utilization remains uncertain, owing to methodological limitations. Efforts to assess performance and effectiveness more rigorously will be needed as early warning system use becomes more widespread.

Original languageEnglish (US)
Pages (from-to)1454-1465
Number of pages12
JournalAnnals of the American Thoracic Society
Volume11
Issue number9
DOIs
StatePublished - Nov 1 2014

Fingerprint

Aptitude
Health Resources
Heart Arrest
Research Personnel
ROC Curve
Observational Studies
Mortality
Length of Stay
Population Characteristics
Mechanical Ventilators
Critical Care
MEDLINE
Respiratory Insufficiency
Sample Size
Language
Databases
Lung

Keywords

  • Clinical deterioration
  • Early warning systems
  • Systematic review

ASJC Scopus subject areas

  • Pulmonary and Respiratory Medicine
  • Medicine(all)

Cite this

Early warning system scores for clinical deterioration in hospitalized patients : A systematic review. / Smith, M. E Beth; Chiovaro, Joseph; O'Neil, Maya; Kansagara, Devan; Quinones, Ana; Freeman, Michele; Motu'apuaka, Makalapua L.; Slatore, Christopher G.

In: Annals of the American Thoracic Society, Vol. 11, No. 9, 01.11.2014, p. 1454-1465.

Research output: Contribution to journalArticle

Smith, M. E Beth ; Chiovaro, Joseph ; O'Neil, Maya ; Kansagara, Devan ; Quinones, Ana ; Freeman, Michele ; Motu'apuaka, Makalapua L. ; Slatore, Christopher G. / Early warning system scores for clinical deterioration in hospitalized patients : A systematic review. In: Annals of the American Thoracic Society. 2014 ; Vol. 11, No. 9. pp. 1454-1465.
@article{077c6cd6dc484e529093a304516ddb5a,
title = "Early warning system scores for clinical deterioration in hospitalized patients: A systematic review",
abstract = "Rationale: Early warning system (EWS) scores are used by hospital care teams to recognize early signs of clinical deterioration and trigger more intensive care.Objective: To systematically review the evidence on the ability of early warning system scores to predict a patient's risk of clinical deterioration and the impact of early warning system implementation on health outcomes and resource utilization.Methods: We searched the MEDLINE, CINAHL, and Cochrane Central Register of Controlled Trials databases through May 2014. We included English-language studies of early warning system scores used with adults admitted to medical or surgical wards. We abstracted study characteristics, including population, setting, sample size, duration, and criteria used for early warning system scoring. For predictive ability, the primary outcomes were modeled for discrimination on 48-hour mortality, cardiac arrest, or pulmonary arrest. Outcomes for the impact of early warning system implementation included 30-day mortality, cardiovascular events, use of vasopressors, respiratory failure, days on ventilator, and resource utilization. We assessed study quality using a modified Quality in Prognosis Studies assessment tool where applicable.Measurements and Main Results: Of 11,183 citations studies reviewed, one controlled trial and 20 observational studies of 13 unique models met our inclusion criteria. In eight studies, researchers addressed the predictive ability of early warning system tools and found a strong predictive value for death (area under the receiver operating characteristic curve [AUROC], 0.88-0.93) and cardiac arrest (AUROC, 0.74-0.86) within 48 hours. In 13 studies (one controlled trial and 12 pre-post observational studies), researchers addressed the impact on health outcomes and resource utilization and had mixed results. The one controlled trial was of good quality, and the researchers found no difference in mortality, transfers to the ICU, or length of hospital stay. The pre-post designs of the remaining studies have significant methodological limitations, resulting in insufficient evidence to draw conclusions.Conclusions: Early warning system scores perform well for prediction of cardiac arrest and death within 48 hours, although the impact on health outcomes and resource utilization remains uncertain, owing to methodological limitations. Efforts to assess performance and effectiveness more rigorously will be needed as early warning system use becomes more widespread.",
keywords = "Clinical deterioration, Early warning systems, Systematic review",
author = "Smith, {M. E Beth} and Joseph Chiovaro and Maya O'Neil and Devan Kansagara and Ana Quinones and Michele Freeman and Motu'apuaka, {Makalapua L.} and Slatore, {Christopher G.}",
year = "2014",
month = "11",
day = "1",
doi = "10.1513/AnnalsATS.201403-102OC",
language = "English (US)",
volume = "11",
pages = "1454--1465",
journal = "Annals of the American Thoracic Society",
issn = "2325-6621",
publisher = "American Thoracic Society",
number = "9",

}

TY - JOUR

T1 - Early warning system scores for clinical deterioration in hospitalized patients

T2 - A systematic review

AU - Smith, M. E Beth

AU - Chiovaro, Joseph

AU - O'Neil, Maya

AU - Kansagara, Devan

AU - Quinones, Ana

AU - Freeman, Michele

AU - Motu'apuaka, Makalapua L.

AU - Slatore, Christopher G.

PY - 2014/11/1

Y1 - 2014/11/1

N2 - Rationale: Early warning system (EWS) scores are used by hospital care teams to recognize early signs of clinical deterioration and trigger more intensive care.Objective: To systematically review the evidence on the ability of early warning system scores to predict a patient's risk of clinical deterioration and the impact of early warning system implementation on health outcomes and resource utilization.Methods: We searched the MEDLINE, CINAHL, and Cochrane Central Register of Controlled Trials databases through May 2014. We included English-language studies of early warning system scores used with adults admitted to medical or surgical wards. We abstracted study characteristics, including population, setting, sample size, duration, and criteria used for early warning system scoring. For predictive ability, the primary outcomes were modeled for discrimination on 48-hour mortality, cardiac arrest, or pulmonary arrest. Outcomes for the impact of early warning system implementation included 30-day mortality, cardiovascular events, use of vasopressors, respiratory failure, days on ventilator, and resource utilization. We assessed study quality using a modified Quality in Prognosis Studies assessment tool where applicable.Measurements and Main Results: Of 11,183 citations studies reviewed, one controlled trial and 20 observational studies of 13 unique models met our inclusion criteria. In eight studies, researchers addressed the predictive ability of early warning system tools and found a strong predictive value for death (area under the receiver operating characteristic curve [AUROC], 0.88-0.93) and cardiac arrest (AUROC, 0.74-0.86) within 48 hours. In 13 studies (one controlled trial and 12 pre-post observational studies), researchers addressed the impact on health outcomes and resource utilization and had mixed results. The one controlled trial was of good quality, and the researchers found no difference in mortality, transfers to the ICU, or length of hospital stay. The pre-post designs of the remaining studies have significant methodological limitations, resulting in insufficient evidence to draw conclusions.Conclusions: Early warning system scores perform well for prediction of cardiac arrest and death within 48 hours, although the impact on health outcomes and resource utilization remains uncertain, owing to methodological limitations. Efforts to assess performance and effectiveness more rigorously will be needed as early warning system use becomes more widespread.

AB - Rationale: Early warning system (EWS) scores are used by hospital care teams to recognize early signs of clinical deterioration and trigger more intensive care.Objective: To systematically review the evidence on the ability of early warning system scores to predict a patient's risk of clinical deterioration and the impact of early warning system implementation on health outcomes and resource utilization.Methods: We searched the MEDLINE, CINAHL, and Cochrane Central Register of Controlled Trials databases through May 2014. We included English-language studies of early warning system scores used with adults admitted to medical or surgical wards. We abstracted study characteristics, including population, setting, sample size, duration, and criteria used for early warning system scoring. For predictive ability, the primary outcomes were modeled for discrimination on 48-hour mortality, cardiac arrest, or pulmonary arrest. Outcomes for the impact of early warning system implementation included 30-day mortality, cardiovascular events, use of vasopressors, respiratory failure, days on ventilator, and resource utilization. We assessed study quality using a modified Quality in Prognosis Studies assessment tool where applicable.Measurements and Main Results: Of 11,183 citations studies reviewed, one controlled trial and 20 observational studies of 13 unique models met our inclusion criteria. In eight studies, researchers addressed the predictive ability of early warning system tools and found a strong predictive value for death (area under the receiver operating characteristic curve [AUROC], 0.88-0.93) and cardiac arrest (AUROC, 0.74-0.86) within 48 hours. In 13 studies (one controlled trial and 12 pre-post observational studies), researchers addressed the impact on health outcomes and resource utilization and had mixed results. The one controlled trial was of good quality, and the researchers found no difference in mortality, transfers to the ICU, or length of hospital stay. The pre-post designs of the remaining studies have significant methodological limitations, resulting in insufficient evidence to draw conclusions.Conclusions: Early warning system scores perform well for prediction of cardiac arrest and death within 48 hours, although the impact on health outcomes and resource utilization remains uncertain, owing to methodological limitations. Efforts to assess performance and effectiveness more rigorously will be needed as early warning system use becomes more widespread.

KW - Clinical deterioration

KW - Early warning systems

KW - Systematic review

UR - http://www.scopus.com/inward/record.url?scp=84914676360&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84914676360&partnerID=8YFLogxK

U2 - 10.1513/AnnalsATS.201403-102OC

DO - 10.1513/AnnalsATS.201403-102OC

M3 - Article

VL - 11

SP - 1454

EP - 1465

JO - Annals of the American Thoracic Society

JF - Annals of the American Thoracic Society

SN - 2325-6621

IS - 9

ER -