Reliability of readmission rates as a hospital quality measure in cardiac surgery

Terry Shih, Justin B. Dimick

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

Background Recent policy interventions have reduced payments to hospitals with higher-than-predicted risk-adjusted readmission rates. However, whether readmission rates reliably discriminate deficiencies in hospital quality is uncertain. We sought to determine the reliability of 30-day readmission rates after cardiac operations as a measure of hospital performance and evaluate the effect of hospital caseload on reliability. Methods We examined national Medicare beneficiaries undergoing coronary artery bypass graft operations for 2006 to 2008 (n = 244,874 patients, n = 1,210 hospitals). First, we performed multivariable logistic regression examining patient factors to calculate a risk-adjusted readmission rate for each hospital. We then used hierarchical modeling to estimate the reliability of this quality measure for each hospital. Finally, we determined the proportion of total variation attributable to three factors: true signal, statistical noise, and patient factors. Results A median of 151 (25% to 75% interquartile range, 79 to 265) coronary artery bypasses were performed per hospital during the 3-year period. The median risk-adjusted 30-day readmission rate was 17.6% (25% to 75% interquartile range, 14.4% to 20.8%). Of the variation in readmission rates, 55% was explained by measurement noise, 4% could be attributed to patient characteristics, and the remaining 41% represented true signal in readmission rates. Only 53 hospitals (4.4%) achieved a proficient level of reliability exceeding 0.70. To achieve this reliability, 599 cases were required during the 3-year period. In 33.7% of hospitals, a moderate degree of reliability exceeding 0.5 was achieved, which required 218 cases. Conclusions The vast majority of hospitals do not achieve a minimum acceptable level of reliability for 30-day readmission rates. Despite recent enthusiasm, readmission rates are not a reliable measure of hospital quality in cardiac surgery.

Original languageEnglish (US)
Pages (from-to)1214-1218
Number of pages5
JournalAnnals of Thoracic Surgery
Volume97
Issue number4
DOIs
StatePublished - Jan 1 2014
Externally publishedYes

Fingerprint

Thoracic Surgery
Coronary Artery Bypass
Medicare
Noise
Logistic Models
Transplants

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Surgery
  • Pulmonary and Respiratory Medicine

Cite this

Reliability of readmission rates as a hospital quality measure in cardiac surgery. / Shih, Terry; Dimick, Justin B.

In: Annals of Thoracic Surgery, Vol. 97, No. 4, 01.01.2014, p. 1214-1218.

Research output: Contribution to journalArticle

@article{336b19eb8c3d4d8aa16cfc0b9d8a2efe,
title = "Reliability of readmission rates as a hospital quality measure in cardiac surgery",
abstract = "Background Recent policy interventions have reduced payments to hospitals with higher-than-predicted risk-adjusted readmission rates. However, whether readmission rates reliably discriminate deficiencies in hospital quality is uncertain. We sought to determine the reliability of 30-day readmission rates after cardiac operations as a measure of hospital performance and evaluate the effect of hospital caseload on reliability. Methods We examined national Medicare beneficiaries undergoing coronary artery bypass graft operations for 2006 to 2008 (n = 244,874 patients, n = 1,210 hospitals). First, we performed multivariable logistic regression examining patient factors to calculate a risk-adjusted readmission rate for each hospital. We then used hierarchical modeling to estimate the reliability of this quality measure for each hospital. Finally, we determined the proportion of total variation attributable to three factors: true signal, statistical noise, and patient factors. Results A median of 151 (25{\%} to 75{\%} interquartile range, 79 to 265) coronary artery bypasses were performed per hospital during the 3-year period. The median risk-adjusted 30-day readmission rate was 17.6{\%} (25{\%} to 75{\%} interquartile range, 14.4{\%} to 20.8{\%}). Of the variation in readmission rates, 55{\%} was explained by measurement noise, 4{\%} could be attributed to patient characteristics, and the remaining 41{\%} represented true signal in readmission rates. Only 53 hospitals (4.4{\%}) achieved a proficient level of reliability exceeding 0.70. To achieve this reliability, 599 cases were required during the 3-year period. In 33.7{\%} of hospitals, a moderate degree of reliability exceeding 0.5 was achieved, which required 218 cases. Conclusions The vast majority of hospitals do not achieve a minimum acceptable level of reliability for 30-day readmission rates. Despite recent enthusiasm, readmission rates are not a reliable measure of hospital quality in cardiac surgery.",
author = "Terry Shih and Dimick, {Justin B.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1016/j.athoracsur.2013.11.048",
language = "English (US)",
volume = "97",
pages = "1214--1218",
journal = "Annals of Thoracic Surgery",
issn = "0003-4975",
publisher = "Elsevier USA",
number = "4",

}

TY - JOUR

T1 - Reliability of readmission rates as a hospital quality measure in cardiac surgery

AU - Shih, Terry

AU - Dimick, Justin B.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Background Recent policy interventions have reduced payments to hospitals with higher-than-predicted risk-adjusted readmission rates. However, whether readmission rates reliably discriminate deficiencies in hospital quality is uncertain. We sought to determine the reliability of 30-day readmission rates after cardiac operations as a measure of hospital performance and evaluate the effect of hospital caseload on reliability. Methods We examined national Medicare beneficiaries undergoing coronary artery bypass graft operations for 2006 to 2008 (n = 244,874 patients, n = 1,210 hospitals). First, we performed multivariable logistic regression examining patient factors to calculate a risk-adjusted readmission rate for each hospital. We then used hierarchical modeling to estimate the reliability of this quality measure for each hospital. Finally, we determined the proportion of total variation attributable to three factors: true signal, statistical noise, and patient factors. Results A median of 151 (25% to 75% interquartile range, 79 to 265) coronary artery bypasses were performed per hospital during the 3-year period. The median risk-adjusted 30-day readmission rate was 17.6% (25% to 75% interquartile range, 14.4% to 20.8%). Of the variation in readmission rates, 55% was explained by measurement noise, 4% could be attributed to patient characteristics, and the remaining 41% represented true signal in readmission rates. Only 53 hospitals (4.4%) achieved a proficient level of reliability exceeding 0.70. To achieve this reliability, 599 cases were required during the 3-year period. In 33.7% of hospitals, a moderate degree of reliability exceeding 0.5 was achieved, which required 218 cases. Conclusions The vast majority of hospitals do not achieve a minimum acceptable level of reliability for 30-day readmission rates. Despite recent enthusiasm, readmission rates are not a reliable measure of hospital quality in cardiac surgery.

AB - Background Recent policy interventions have reduced payments to hospitals with higher-than-predicted risk-adjusted readmission rates. However, whether readmission rates reliably discriminate deficiencies in hospital quality is uncertain. We sought to determine the reliability of 30-day readmission rates after cardiac operations as a measure of hospital performance and evaluate the effect of hospital caseload on reliability. Methods We examined national Medicare beneficiaries undergoing coronary artery bypass graft operations for 2006 to 2008 (n = 244,874 patients, n = 1,210 hospitals). First, we performed multivariable logistic regression examining patient factors to calculate a risk-adjusted readmission rate for each hospital. We then used hierarchical modeling to estimate the reliability of this quality measure for each hospital. Finally, we determined the proportion of total variation attributable to three factors: true signal, statistical noise, and patient factors. Results A median of 151 (25% to 75% interquartile range, 79 to 265) coronary artery bypasses were performed per hospital during the 3-year period. The median risk-adjusted 30-day readmission rate was 17.6% (25% to 75% interquartile range, 14.4% to 20.8%). Of the variation in readmission rates, 55% was explained by measurement noise, 4% could be attributed to patient characteristics, and the remaining 41% represented true signal in readmission rates. Only 53 hospitals (4.4%) achieved a proficient level of reliability exceeding 0.70. To achieve this reliability, 599 cases were required during the 3-year period. In 33.7% of hospitals, a moderate degree of reliability exceeding 0.5 was achieved, which required 218 cases. Conclusions The vast majority of hospitals do not achieve a minimum acceptable level of reliability for 30-day readmission rates. Despite recent enthusiasm, readmission rates are not a reliable measure of hospital quality in cardiac surgery.

UR - http://www.scopus.com/inward/record.url?scp=84897439864&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84897439864&partnerID=8YFLogxK

U2 - 10.1016/j.athoracsur.2013.11.048

DO - 10.1016/j.athoracsur.2013.11.048

M3 - Article

C2 - 24492060

AN - SCOPUS:84897439864

VL - 97

SP - 1214

EP - 1218

JO - Annals of Thoracic Surgery

JF - Annals of Thoracic Surgery

SN - 0003-4975

IS - 4

ER -