Reliability of SNOMED-CT coding by three physicians using two terminology browsers.

Michael Chiang, John C. Hwang, Alexander C. Yu, Daniel S. Casper, James J. Cimino, Justin B. Starren

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

SNOMED-CT has been promoted as a reference terminology for electronic health record (EHR) systems. Many important EHR functions are based on the assumption that medical concepts will be coded consistently by different users. This study is designed to measure agreement among three physicians using two SNOMED-CT terminology browsers to encode 242 concepts from five ophthalmology case presentations in a publicly-available clinical journal. Inter-coder reliability, based on exact coding match by each physician, was 44% using one browser and 53% using the other. Intra-coder reliability testing revealed that a different SNOMED-CT code was obtained up to 55% of the time when the two browsers were used by one user to encode the same concept. These results suggest that the reliability of SNOMED-CT coding is imperfect, and may be a function of browsing methodology. A combination of physician training, terminology refinement, and browser improvement may help increase the reproducibility of SNOMED-CT coding.

Original languageEnglish (US)
Pages (from-to)131-135
Number of pages5
JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
StatePublished - 2006
Externally publishedYes

Fingerprint

Systematized Nomenclature of Medicine
Terminology
Physicians
Electronic Health Records
Ophthalmology
Reproducibility of Results

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Reliability of SNOMED-CT coding by three physicians using two terminology browsers. / Chiang, Michael; Hwang, John C.; Yu, Alexander C.; Casper, Daniel S.; Cimino, James J.; Starren, Justin B.

In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium, 2006, p. 131-135.

Research output: Contribution to journalArticle

Chiang, Michael ; Hwang, John C. ; Yu, Alexander C. ; Casper, Daniel S. ; Cimino, James J. ; Starren, Justin B. / Reliability of SNOMED-CT coding by three physicians using two terminology browsers. In: AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium. 2006 ; pp. 131-135.
@article{afd218d2566c46c39753a66238bbb47b,
title = "Reliability of SNOMED-CT coding by three physicians using two terminology browsers.",
abstract = "SNOMED-CT has been promoted as a reference terminology for electronic health record (EHR) systems. Many important EHR functions are based on the assumption that medical concepts will be coded consistently by different users. This study is designed to measure agreement among three physicians using two SNOMED-CT terminology browsers to encode 242 concepts from five ophthalmology case presentations in a publicly-available clinical journal. Inter-coder reliability, based on exact coding match by each physician, was 44{\%} using one browser and 53{\%} using the other. Intra-coder reliability testing revealed that a different SNOMED-CT code was obtained up to 55{\%} of the time when the two browsers were used by one user to encode the same concept. These results suggest that the reliability of SNOMED-CT coding is imperfect, and may be a function of browsing methodology. A combination of physician training, terminology refinement, and browser improvement may help increase the reproducibility of SNOMED-CT coding.",
author = "Michael Chiang and Hwang, {John C.} and Yu, {Alexander C.} and Casper, {Daniel S.} and Cimino, {James J.} and Starren, {Justin B.}",
year = "2006",
language = "English (US)",
pages = "131--135",
journal = "AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium",
issn = "1559-4076",
publisher = "American Medical Informatics Association",

}

TY - JOUR

T1 - Reliability of SNOMED-CT coding by three physicians using two terminology browsers.

AU - Chiang, Michael

AU - Hwang, John C.

AU - Yu, Alexander C.

AU - Casper, Daniel S.

AU - Cimino, James J.

AU - Starren, Justin B.

PY - 2006

Y1 - 2006

N2 - SNOMED-CT has been promoted as a reference terminology for electronic health record (EHR) systems. Many important EHR functions are based on the assumption that medical concepts will be coded consistently by different users. This study is designed to measure agreement among three physicians using two SNOMED-CT terminology browsers to encode 242 concepts from five ophthalmology case presentations in a publicly-available clinical journal. Inter-coder reliability, based on exact coding match by each physician, was 44% using one browser and 53% using the other. Intra-coder reliability testing revealed that a different SNOMED-CT code was obtained up to 55% of the time when the two browsers were used by one user to encode the same concept. These results suggest that the reliability of SNOMED-CT coding is imperfect, and may be a function of browsing methodology. A combination of physician training, terminology refinement, and browser improvement may help increase the reproducibility of SNOMED-CT coding.

AB - SNOMED-CT has been promoted as a reference terminology for electronic health record (EHR) systems. Many important EHR functions are based on the assumption that medical concepts will be coded consistently by different users. This study is designed to measure agreement among three physicians using two SNOMED-CT terminology browsers to encode 242 concepts from five ophthalmology case presentations in a publicly-available clinical journal. Inter-coder reliability, based on exact coding match by each physician, was 44% using one browser and 53% using the other. Intra-coder reliability testing revealed that a different SNOMED-CT code was obtained up to 55% of the time when the two browsers were used by one user to encode the same concept. These results suggest that the reliability of SNOMED-CT coding is imperfect, and may be a function of browsing methodology. A combination of physician training, terminology refinement, and browser improvement may help increase the reproducibility of SNOMED-CT coding.

UR - http://www.scopus.com/inward/record.url?scp=34250711920&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34250711920&partnerID=8YFLogxK

M3 - Article

C2 - 17238317

AN - SCOPUS:34250711920

SP - 131

EP - 135

JO - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

JF - AMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium

SN - 1559-4076

ER -