Accuracy and reliability of remote retinopathy of prematurity diagnosis

Michael Chiang, Jeremy D. Keenan, Justin Starren, Yunling E. Du, William M. Schiff, Gaetano R. Barile, Joan Li, Rose Anne Johnson, Ditte J. Hess, John T. Flynn

Research output: Contribution to journalArticle

90 Citations (Scopus)

Abstract

Objective: To determine the accuracy and reliability of retinopathy of prematurity (ROP) diagnosis using remote review of digital images by 3 masked ophthalmologist readers. Methods: An atlas was compiled of 410 retinal photographs from 163 eyes of 64 low-birth-weight infants taken using a wide-angle digital fundus camera. All the images were independently reviewed by 3 readers, and the diagnosis in each eye was classified into 1 of 4 ordinal categories: no ROP, mild ROP, type 2 prethreshold ROP, or ROP requiring treatment. Findings were compared with a reference standard of dilated indirect ophthalmoscopy with scleral depression performed by an experienced pediatric ophthalmologist. Results: Sensitivities/specificities of the diagnosis of any ROP were 0.845/0.910 for the first reader, 0.816/0.955 for the second reader, and 0.864/0.493 for the third reader. Sensitivities/specificities of the diagnosis of ROP requiring treatment were 0.850/0.960 for the first reader, 0.850/0.973 for the second reader, and 0.900/0.953 for the third reader. When ROP was classified into ordinal categories, the overall weighted κ for interreader reliability was 0.743. Intrareader reliability for detection of low-risk prethreshold ROP or worse was 100% for all readers. Conclusion: The accuracy, interreader reliability, and intrareader reliability of remote diagnosis of clinically relevant ROP based on digital imaging are substantial.

Original languageEnglish (US)
Pages (from-to)322-327
Number of pages6
JournalArchives of Ophthalmology
Volume124
Issue number3
DOIs
StatePublished - Mar 2006
Externally publishedYes

Fingerprint

Retinopathy of Prematurity
Sensitivity and Specificity
Ophthalmoscopy
Atlases
Low Birth Weight Infant
Pediatrics

ASJC Scopus subject areas

  • Ophthalmology

Cite this

Chiang, M., Keenan, J. D., Starren, J., Du, Y. E., Schiff, W. M., Barile, G. R., ... Flynn, J. T. (2006). Accuracy and reliability of remote retinopathy of prematurity diagnosis. Archives of Ophthalmology, 124(3), 322-327. https://doi.org/10.1001/archopht.124.3.322

Accuracy and reliability of remote retinopathy of prematurity diagnosis. / Chiang, Michael; Keenan, Jeremy D.; Starren, Justin; Du, Yunling E.; Schiff, William M.; Barile, Gaetano R.; Li, Joan; Johnson, Rose Anne; Hess, Ditte J.; Flynn, John T.

In: Archives of Ophthalmology, Vol. 124, No. 3, 03.2006, p. 322-327.

Research output: Contribution to journalArticle

Chiang, M, Keenan, JD, Starren, J, Du, YE, Schiff, WM, Barile, GR, Li, J, Johnson, RA, Hess, DJ & Flynn, JT 2006, 'Accuracy and reliability of remote retinopathy of prematurity diagnosis', Archives of Ophthalmology, vol. 124, no. 3, pp. 322-327. https://doi.org/10.1001/archopht.124.3.322
Chiang, Michael ; Keenan, Jeremy D. ; Starren, Justin ; Du, Yunling E. ; Schiff, William M. ; Barile, Gaetano R. ; Li, Joan ; Johnson, Rose Anne ; Hess, Ditte J. ; Flynn, John T. / Accuracy and reliability of remote retinopathy of prematurity diagnosis. In: Archives of Ophthalmology. 2006 ; Vol. 124, No. 3. pp. 322-327.
@article{4f503b1ecff34928bea6ffd58177da62,
title = "Accuracy and reliability of remote retinopathy of prematurity diagnosis",
abstract = "Objective: To determine the accuracy and reliability of retinopathy of prematurity (ROP) diagnosis using remote review of digital images by 3 masked ophthalmologist readers. Methods: An atlas was compiled of 410 retinal photographs from 163 eyes of 64 low-birth-weight infants taken using a wide-angle digital fundus camera. All the images were independently reviewed by 3 readers, and the diagnosis in each eye was classified into 1 of 4 ordinal categories: no ROP, mild ROP, type 2 prethreshold ROP, or ROP requiring treatment. Findings were compared with a reference standard of dilated indirect ophthalmoscopy with scleral depression performed by an experienced pediatric ophthalmologist. Results: Sensitivities/specificities of the diagnosis of any ROP were 0.845/0.910 for the first reader, 0.816/0.955 for the second reader, and 0.864/0.493 for the third reader. Sensitivities/specificities of the diagnosis of ROP requiring treatment were 0.850/0.960 for the first reader, 0.850/0.973 for the second reader, and 0.900/0.953 for the third reader. When ROP was classified into ordinal categories, the overall weighted κ for interreader reliability was 0.743. Intrareader reliability for detection of low-risk prethreshold ROP or worse was 100{\%} for all readers. Conclusion: The accuracy, interreader reliability, and intrareader reliability of remote diagnosis of clinically relevant ROP based on digital imaging are substantial.",
author = "Michael Chiang and Keenan, {Jeremy D.} and Justin Starren and Du, {Yunling E.} and Schiff, {William M.} and Barile, {Gaetano R.} and Joan Li and Johnson, {Rose Anne} and Hess, {Ditte J.} and Flynn, {John T.}",
year = "2006",
month = "3",
doi = "10.1001/archopht.124.3.322",
language = "English (US)",
volume = "124",
pages = "322--327",
journal = "JAMA Ophthalmology",
issn = "2168-6165",
publisher = "American Medical Association",
number = "3",

}

TY - JOUR

T1 - Accuracy and reliability of remote retinopathy of prematurity diagnosis

AU - Chiang, Michael

AU - Keenan, Jeremy D.

AU - Starren, Justin

AU - Du, Yunling E.

AU - Schiff, William M.

AU - Barile, Gaetano R.

AU - Li, Joan

AU - Johnson, Rose Anne

AU - Hess, Ditte J.

AU - Flynn, John T.

PY - 2006/3

Y1 - 2006/3

N2 - Objective: To determine the accuracy and reliability of retinopathy of prematurity (ROP) diagnosis using remote review of digital images by 3 masked ophthalmologist readers. Methods: An atlas was compiled of 410 retinal photographs from 163 eyes of 64 low-birth-weight infants taken using a wide-angle digital fundus camera. All the images were independently reviewed by 3 readers, and the diagnosis in each eye was classified into 1 of 4 ordinal categories: no ROP, mild ROP, type 2 prethreshold ROP, or ROP requiring treatment. Findings were compared with a reference standard of dilated indirect ophthalmoscopy with scleral depression performed by an experienced pediatric ophthalmologist. Results: Sensitivities/specificities of the diagnosis of any ROP were 0.845/0.910 for the first reader, 0.816/0.955 for the second reader, and 0.864/0.493 for the third reader. Sensitivities/specificities of the diagnosis of ROP requiring treatment were 0.850/0.960 for the first reader, 0.850/0.973 for the second reader, and 0.900/0.953 for the third reader. When ROP was classified into ordinal categories, the overall weighted κ for interreader reliability was 0.743. Intrareader reliability for detection of low-risk prethreshold ROP or worse was 100% for all readers. Conclusion: The accuracy, interreader reliability, and intrareader reliability of remote diagnosis of clinically relevant ROP based on digital imaging are substantial.

AB - Objective: To determine the accuracy and reliability of retinopathy of prematurity (ROP) diagnosis using remote review of digital images by 3 masked ophthalmologist readers. Methods: An atlas was compiled of 410 retinal photographs from 163 eyes of 64 low-birth-weight infants taken using a wide-angle digital fundus camera. All the images were independently reviewed by 3 readers, and the diagnosis in each eye was classified into 1 of 4 ordinal categories: no ROP, mild ROP, type 2 prethreshold ROP, or ROP requiring treatment. Findings were compared with a reference standard of dilated indirect ophthalmoscopy with scleral depression performed by an experienced pediatric ophthalmologist. Results: Sensitivities/specificities of the diagnosis of any ROP were 0.845/0.910 for the first reader, 0.816/0.955 for the second reader, and 0.864/0.493 for the third reader. Sensitivities/specificities of the diagnosis of ROP requiring treatment were 0.850/0.960 for the first reader, 0.850/0.973 for the second reader, and 0.900/0.953 for the third reader. When ROP was classified into ordinal categories, the overall weighted κ for interreader reliability was 0.743. Intrareader reliability for detection of low-risk prethreshold ROP or worse was 100% for all readers. Conclusion: The accuracy, interreader reliability, and intrareader reliability of remote diagnosis of clinically relevant ROP based on digital imaging are substantial.

UR - http://www.scopus.com/inward/record.url?scp=33644912891&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33644912891&partnerID=8YFLogxK

U2 - 10.1001/archopht.124.3.322

DO - 10.1001/archopht.124.3.322

M3 - Article

VL - 124

SP - 322

EP - 327

JO - JAMA Ophthalmology

JF - JAMA Ophthalmology

SN - 2168-6165

IS - 3

ER -