Telemedical diagnosis of retinopathy of prematurity: Accuracy of expert versus non-expert graders

Steven L. Williams, Lu Wang, Steven A. Kane, Thomas C. Lee, David J. Weissgold, Audina M. Berrocal, Daniel Rabinowitz, Justin Starren, John T. Flynn, Michael F. Chiang

Research output: Contribution to journalArticle

34 Scopus citations

Abstract

Background/aims: To assess accuracy of telemedical retinopathy of prematurity (ROP) diagnosis by trained non-expert graders compared with expert graders. Methods: Eye examinations (n=248) from 67 consecutive infants were captured using wide-angle retinal photography (RetCam-II, Clarity Medical Systems, Pleasanton, California, USA). Non-expert graders attended two 1-h training sessions on image-based ROP diagnosis. Using a web-based telemedicine system, 14 non-expert and three expert graders provided a diagnosis for each eye: no ROP, mild ROP, type 2 pre-threshold ROP or treatment-requiring ROP. All diagnoses were compared with a reference standard of dilated indirect ophthalmoscopy by an experienced paediatric ophthalmologist. Results: For detection of type 2 or worse ROP, the mean (range) sensitivities and specificities were 0.95 (0.94-0.97) and 0.93 (0.91-0.96) for experts, 0.87 (0.71-0.97) and 0.73 (0.39-0.95) for resident non-experts, and 0.73 (0.41-0.88) and 0.91 (0.84-0.96) for student non-experts, respectively. For detection of treatment-requiring ROP, the mean (range) sensitivities and specificities were 1.00 (1.00-1.00) and 0.93 (0.88-0.96) for experts, 0.88 (0.50-1.00) and 0.84 (0.71-0.98) for resident non-experts, and 0.82 (0.42-1.00) and 0.92 (0.83-0.97) for student non-experts, respectively. Conclusions: Mean sensitivity and specificity of trained non-experts were lower than that of experts, although several non-experts had high accuracy. Development of methods for training non-expert graders may help support telemedical ROP evaluation.

Original languageEnglish (US)
Pages (from-to)351-356
Number of pages6
JournalBritish Journal of Ophthalmology
Volume94
Issue number3
DOIs
StatePublished - Mar 1 2010
Externally publishedYes

ASJC Scopus subject areas

  • Ophthalmology
  • Sensory Systems
  • Cellular and Molecular Neuroscience

Fingerprint Dive into the research topics of 'Telemedical diagnosis of retinopathy of prematurity: Accuracy of expert versus non-expert graders'. Together they form a unique fingerprint.

  • Cite this

    Williams, S. L., Wang, L., Kane, S. A., Lee, T. C., Weissgold, D. J., Berrocal, A. M., Rabinowitz, D., Starren, J., Flynn, J. T., & Chiang, M. F. (2010). Telemedical diagnosis of retinopathy of prematurity: Accuracy of expert versus non-expert graders. British Journal of Ophthalmology, 94(3), 351-356. https://doi.org/10.1136/bjo.2009.166348