From simply inaccurate to complex and inaccurate: complexity in standards-based quality measures.

David Dorr, Aaron Cohen, Marsha Pierre Jacques Williams, John Hurdle

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Quality measurement has been slow to make a major impact in health care. Initial measures were too simple to affect outcomes of importance. Incentive programs such as Meaningful Use encourage better measures, but in process may become more complex. We evaluated the measures selected for Meaningful Use in two ways: we counted unique concept identifiers, taxonomies, and aggregated concepts as measures of complexity; and we surveyed informatics professionals to assess difficulty. There were 20,316 unique concept identifiers, 35 taxonomies, and 317 aggregated concepts across the 45 measures. Half the respondents reported measures at least moderately difficult. The number of identifiers was associated with fewer implementations (r=-.37); rating-of-difficulty was associated with more taxonomies (r=.24). The impact on accuracy may be substantial when moving to measures intended to be more relevant to clinical outcomes but requiring the use of more taxonomies, unused structured concept identifiers, or concepts only in free text fields.

Original languageEnglish (US)
Pages (from-to)331-338
Number of pages8
JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
Volume2011
StatePublished - 2011

Fingerprint

Informatics
Process Assessment (Health Care)
Motivation
Delivery of Health Care
Surveys and Questionnaires

ASJC Scopus subject areas

  • Medicine(all)

Cite this

From simply inaccurate to complex and inaccurate : complexity in standards-based quality measures. / Dorr, David; Cohen, Aaron; Williams, Marsha Pierre Jacques; Hurdle, John.

In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, Vol. 2011, 2011, p. 331-338.

Research output: Contribution to journalArticle

@article{177ad9ea74544bb9825c76e2987bc2c9,
title = "From simply inaccurate to complex and inaccurate: complexity in standards-based quality measures.",
abstract = "Quality measurement has been slow to make a major impact in health care. Initial measures were too simple to affect outcomes of importance. Incentive programs such as Meaningful Use encourage better measures, but in process may become more complex. We evaluated the measures selected for Meaningful Use in two ways: we counted unique concept identifiers, taxonomies, and aggregated concepts as measures of complexity; and we surveyed informatics professionals to assess difficulty. There were 20,316 unique concept identifiers, 35 taxonomies, and 317 aggregated concepts across the 45 measures. Half the respondents reported measures at least moderately difficult. The number of identifiers was associated with fewer implementations (r=-.37); rating-of-difficulty was associated with more taxonomies (r=.24). The impact on accuracy may be substantial when moving to measures intended to be more relevant to clinical outcomes but requiring the use of more taxonomies, unused structured concept identifiers, or concepts only in free text fields.",
author = "David Dorr and Aaron Cohen and Williams, {Marsha Pierre Jacques} and John Hurdle",
year = "2011",
language = "English (US)",
volume = "2011",
pages = "331--338",
journal = "AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium",
issn = "1559-4076",
publisher = "American Medical Informatics Association",

}

TY - JOUR

T1 - From simply inaccurate to complex and inaccurate

T2 - complexity in standards-based quality measures.

AU - Dorr, David

AU - Cohen, Aaron

AU - Williams, Marsha Pierre Jacques

AU - Hurdle, John

PY - 2011

Y1 - 2011

N2 - Quality measurement has been slow to make a major impact in health care. Initial measures were too simple to affect outcomes of importance. Incentive programs such as Meaningful Use encourage better measures, but in process may become more complex. We evaluated the measures selected for Meaningful Use in two ways: we counted unique concept identifiers, taxonomies, and aggregated concepts as measures of complexity; and we surveyed informatics professionals to assess difficulty. There were 20,316 unique concept identifiers, 35 taxonomies, and 317 aggregated concepts across the 45 measures. Half the respondents reported measures at least moderately difficult. The number of identifiers was associated with fewer implementations (r=-.37); rating-of-difficulty was associated with more taxonomies (r=.24). The impact on accuracy may be substantial when moving to measures intended to be more relevant to clinical outcomes but requiring the use of more taxonomies, unused structured concept identifiers, or concepts only in free text fields.

AB - Quality measurement has been slow to make a major impact in health care. Initial measures were too simple to affect outcomes of importance. Incentive programs such as Meaningful Use encourage better measures, but in process may become more complex. We evaluated the measures selected for Meaningful Use in two ways: we counted unique concept identifiers, taxonomies, and aggregated concepts as measures of complexity; and we surveyed informatics professionals to assess difficulty. There were 20,316 unique concept identifiers, 35 taxonomies, and 317 aggregated concepts across the 45 measures. Half the respondents reported measures at least moderately difficult. The number of identifiers was associated with fewer implementations (r=-.37); rating-of-difficulty was associated with more taxonomies (r=.24). The impact on accuracy may be substantial when moving to measures intended to be more relevant to clinical outcomes but requiring the use of more taxonomies, unused structured concept identifiers, or concepts only in free text fields.

UR - http://www.scopus.com/inward/record.url?scp=84874213855&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84874213855&partnerID=8YFLogxK

M3 - Article

C2 - 22195085

AN - SCOPUS:84874213855

VL - 2011

SP - 331

EP - 338

JO - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

JF - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

SN - 1559-4076

ER -