Accuracy of Administrative Data for Detection and Categorization of Adult Congenital Heart Disease Patients from an Electronic Medical Record

Craig Broberg, Joel McLarry, Julie Mitchell, Christiane Winter, Julie Doberne, Patricia Woods, Luke Burchill, Joseph Weiss

    Research output: Contribution to journalArticle

    17 Citations (Scopus)

    Abstract

    Diagnostic codes used in healthcare administration have been employed extensively in clinical research to identify target patient populations, including demonstration of important clinical outcomes among adults with congenital heart disease. However, little is known about the reliability of code-derived data in this context. We sought to determine the accuracy of International Classification of Disease-9th Revision (ICD-9) diagnoses and the reliability of retrieval algorithms in adults with congenital heart disease (ACHD). Pilot testing of a hierarchical algorithm to identify ACHD patients and determine their principle congenital diagnosis was performed. A revised algorithm was then applied retrospectively to a sample of all outpatients seen by providers who see general cardiology and ACHD patients. Using all ICD-9 codes available from any encounter, accuracy for detection and categorization of sub-types were compared to physician chart review. After initial testing on 334 patients, the revised algorithm was applied to 740 patients. The sensitivity and specificity for ACHD patient identification from this specialty clinic population were 99 and 88 %, respectively. Of 411 (56 %) non-ACHD patients, 49 were incorrectly categorized as ACHD by the algorithm. Of ACHD patients, 326 of 329 were correctly identified by diagnostic codes and categorization of ACHD defect sub-type was correct in 263 (80 %). Administrative data can be used for identification of ACHD patients based on ICD-9 codes with excellent sensitivity and reasonable specificity. Accurate categorization that would be utilized for quality indicators by ACHD defect type is less robust. Additional testing should be done using non-referral populations.

    Original languageEnglish (US)
    Pages (from-to)719-725
    Number of pages7
    JournalPediatric Cardiology
    Volume36
    Issue number4
    DOIs
    StatePublished - 2015

    Fingerprint

    Electronic Health Records
    Heart Diseases
    International Classification of Diseases
    Congenital Heart Defects
    Data Accuracy
    Sensitivity and Specificity
    Health Services Needs and Demand
    Cardiology
    Population
    Outpatients
    Delivery of Health Care
    Physicians

    Keywords

    • Adult congenital heart disease
    • Diagnostic coding
    • Population studies

    ASJC Scopus subject areas

    • Cardiology and Cardiovascular Medicine
    • Pediatrics, Perinatology, and Child Health

    Cite this

    Accuracy of Administrative Data for Detection and Categorization of Adult Congenital Heart Disease Patients from an Electronic Medical Record. / Broberg, Craig; McLarry, Joel; Mitchell, Julie; Winter, Christiane; Doberne, Julie; Woods, Patricia; Burchill, Luke; Weiss, Joseph.

    In: Pediatric Cardiology, Vol. 36, No. 4, 2015, p. 719-725.

    Research output: Contribution to journalArticle

    Broberg, Craig ; McLarry, Joel ; Mitchell, Julie ; Winter, Christiane ; Doberne, Julie ; Woods, Patricia ; Burchill, Luke ; Weiss, Joseph. / Accuracy of Administrative Data for Detection and Categorization of Adult Congenital Heart Disease Patients from an Electronic Medical Record. In: Pediatric Cardiology. 2015 ; Vol. 36, No. 4. pp. 719-725.
    @article{8e42ae00a1dd428baa794b2e072947a8,
    title = "Accuracy of Administrative Data for Detection and Categorization of Adult Congenital Heart Disease Patients from an Electronic Medical Record",
    abstract = "Diagnostic codes used in healthcare administration have been employed extensively in clinical research to identify target patient populations, including demonstration of important clinical outcomes among adults with congenital heart disease. However, little is known about the reliability of code-derived data in this context. We sought to determine the accuracy of International Classification of Disease-9th Revision (ICD-9) diagnoses and the reliability of retrieval algorithms in adults with congenital heart disease (ACHD). Pilot testing of a hierarchical algorithm to identify ACHD patients and determine their principle congenital diagnosis was performed. A revised algorithm was then applied retrospectively to a sample of all outpatients seen by providers who see general cardiology and ACHD patients. Using all ICD-9 codes available from any encounter, accuracy for detection and categorization of sub-types were compared to physician chart review. After initial testing on 334 patients, the revised algorithm was applied to 740 patients. The sensitivity and specificity for ACHD patient identification from this specialty clinic population were 99 and 88 {\%}, respectively. Of 411 (56 {\%}) non-ACHD patients, 49 were incorrectly categorized as ACHD by the algorithm. Of ACHD patients, 326 of 329 were correctly identified by diagnostic codes and categorization of ACHD defect sub-type was correct in 263 (80 {\%}). Administrative data can be used for identification of ACHD patients based on ICD-9 codes with excellent sensitivity and reasonable specificity. Accurate categorization that would be utilized for quality indicators by ACHD defect type is less robust. Additional testing should be done using non-referral populations.",
    keywords = "Adult congenital heart disease, Diagnostic coding, Population studies",
    author = "Craig Broberg and Joel McLarry and Julie Mitchell and Christiane Winter and Julie Doberne and Patricia Woods and Luke Burchill and Joseph Weiss",
    year = "2015",
    doi = "10.1007/s00246-014-1068-2",
    language = "English (US)",
    volume = "36",
    pages = "719--725",
    journal = "Pediatric Cardiology",
    issn = "0172-0643",
    publisher = "Springer New York",
    number = "4",

    }

    TY - JOUR

    T1 - Accuracy of Administrative Data for Detection and Categorization of Adult Congenital Heart Disease Patients from an Electronic Medical Record

    AU - Broberg, Craig

    AU - McLarry, Joel

    AU - Mitchell, Julie

    AU - Winter, Christiane

    AU - Doberne, Julie

    AU - Woods, Patricia

    AU - Burchill, Luke

    AU - Weiss, Joseph

    PY - 2015

    Y1 - 2015

    N2 - Diagnostic codes used in healthcare administration have been employed extensively in clinical research to identify target patient populations, including demonstration of important clinical outcomes among adults with congenital heart disease. However, little is known about the reliability of code-derived data in this context. We sought to determine the accuracy of International Classification of Disease-9th Revision (ICD-9) diagnoses and the reliability of retrieval algorithms in adults with congenital heart disease (ACHD). Pilot testing of a hierarchical algorithm to identify ACHD patients and determine their principle congenital diagnosis was performed. A revised algorithm was then applied retrospectively to a sample of all outpatients seen by providers who see general cardiology and ACHD patients. Using all ICD-9 codes available from any encounter, accuracy for detection and categorization of sub-types were compared to physician chart review. After initial testing on 334 patients, the revised algorithm was applied to 740 patients. The sensitivity and specificity for ACHD patient identification from this specialty clinic population were 99 and 88 %, respectively. Of 411 (56 %) non-ACHD patients, 49 were incorrectly categorized as ACHD by the algorithm. Of ACHD patients, 326 of 329 were correctly identified by diagnostic codes and categorization of ACHD defect sub-type was correct in 263 (80 %). Administrative data can be used for identification of ACHD patients based on ICD-9 codes with excellent sensitivity and reasonable specificity. Accurate categorization that would be utilized for quality indicators by ACHD defect type is less robust. Additional testing should be done using non-referral populations.

    AB - Diagnostic codes used in healthcare administration have been employed extensively in clinical research to identify target patient populations, including demonstration of important clinical outcomes among adults with congenital heart disease. However, little is known about the reliability of code-derived data in this context. We sought to determine the accuracy of International Classification of Disease-9th Revision (ICD-9) diagnoses and the reliability of retrieval algorithms in adults with congenital heart disease (ACHD). Pilot testing of a hierarchical algorithm to identify ACHD patients and determine their principle congenital diagnosis was performed. A revised algorithm was then applied retrospectively to a sample of all outpatients seen by providers who see general cardiology and ACHD patients. Using all ICD-9 codes available from any encounter, accuracy for detection and categorization of sub-types were compared to physician chart review. After initial testing on 334 patients, the revised algorithm was applied to 740 patients. The sensitivity and specificity for ACHD patient identification from this specialty clinic population were 99 and 88 %, respectively. Of 411 (56 %) non-ACHD patients, 49 were incorrectly categorized as ACHD by the algorithm. Of ACHD patients, 326 of 329 were correctly identified by diagnostic codes and categorization of ACHD defect sub-type was correct in 263 (80 %). Administrative data can be used for identification of ACHD patients based on ICD-9 codes with excellent sensitivity and reasonable specificity. Accurate categorization that would be utilized for quality indicators by ACHD defect type is less robust. Additional testing should be done using non-referral populations.

    KW - Adult congenital heart disease

    KW - Diagnostic coding

    KW - Population studies

    UR - http://www.scopus.com/inward/record.url?scp=84925464830&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84925464830&partnerID=8YFLogxK

    U2 - 10.1007/s00246-014-1068-2

    DO - 10.1007/s00246-014-1068-2

    M3 - Article

    VL - 36

    SP - 719

    EP - 725

    JO - Pediatric Cardiology

    JF - Pediatric Cardiology

    SN - 0172-0643

    IS - 4

    ER -