A Quantitative Severity Scale for Retinopathy of Prematurity Using Deep Learning to Monitor Disease Regression after Treatment

Kishan Gupta, John Campbell, Stanford Taylor, James M. Brown, Susan Ostmo, R. V.Paul Chan, Jennifer Dy, Deniz Erdogmus, Stratis Ioannidis, Jayashree Kalpathy-Cramer, Sang J. Kim, Michael Chiang

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Importance: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide, but treatment failure and disease recurrence are important causes of adverse outcomes in patients with treatment-requiring ROP (TR-ROP). Objectives: To apply an automated ROP vascular severity score obtained using a deep learning algorithm and to assess its utility for objectively monitoring ROP regression after treatment. Design, Setting, and Participants: This retrospective cohort study used data from the Imaging and Informatics in ROP consortium, which comprises 9 tertiary referral centers in North America that screen high volumes of at-risk infants for ROP. Images of 5255 clinical eye examinations from 871 infants performed between July 2011 and December 2016 were assessed for eligibility in the present study. The disease course was assessed with time across the numerous examinations for patients with TR-ROP. Infants born prematurely meeting screening criteria for ROP who developed TR-ROP and who had images captured within 4 weeks before and after treatment as well as at the time of treatment were included. Main Outcomes and Measures: The primary outcome was mean (SD) ROP vascular severity score before, at time of, and after treatment. A deep learning classifier was used to assign a continuous ROP vascular severity score, which ranged from 1 (normal) to 9 (most severe), at each examination. A secondary outcome was the difference in ROP vascular severity score among eyes treated with laser or the vascular endothelial growth factor antagonist bevacizumab. Differences between groups for both outcomes were assessed using unpaired 2-tailed t tests with Bonferroni correction. Results: Of 5255 examined eyes, 91 developed TR-ROP, of which 46 eyes met the inclusion criteria based on the available images. The mean (SD) birth weight of those patients was 653 (185) g, with a mean (SD) gestational age of 24.9 (1.3) weeks. The mean (SD) ROP vascular severity scores significantly increased 2 weeks prior to treatment (4.19 [1.75]), peaked at treatment (7.43 [1.89]), and decreased for at least 2 weeks after treatment (4.00 [1.88]) (all P <.001). Eyes requiring retreatment with laser had higher ROP vascular severity scores at the time of initial treatment compared with eyes receiving a single treatment (P <.001). Conclusions and Relevance: This quantitative ROP vascular severity score appears to consistently reflect clinical disease progression and posttreatment regression in eyes with TR-ROP. These study results may have implications for the monitoring of patients with ROP for treatment failure and disease recurrence and for determining the appropriate level of disease severity for primary treatment in eyes with aggressive disease.

Original languageEnglish (US)
JournalJAMA ophthalmology
DOIs
StatePublished - Jan 1 2019

Fingerprint

Retinopathy of Prematurity
Learning
Blood Vessels
Therapeutics
Treatment Failure
Lasers
Recurrence
Informatics
Retreatment
Physiologic Monitoring
Blindness
North America
Tertiary Care Centers
Birth Weight

ASJC Scopus subject areas

  • Ophthalmology

Cite this

A Quantitative Severity Scale for Retinopathy of Prematurity Using Deep Learning to Monitor Disease Regression after Treatment. / Gupta, Kishan; Campbell, John; Taylor, Stanford; Brown, James M.; Ostmo, Susan; Chan, R. V.Paul; Dy, Jennifer; Erdogmus, Deniz; Ioannidis, Stratis; Kalpathy-Cramer, Jayashree; Kim, Sang J.; Chiang, Michael.

In: JAMA ophthalmology, 01.01.2019.

Research output: Contribution to journalArticle

Gupta, Kishan ; Campbell, John ; Taylor, Stanford ; Brown, James M. ; Ostmo, Susan ; Chan, R. V.Paul ; Dy, Jennifer ; Erdogmus, Deniz ; Ioannidis, Stratis ; Kalpathy-Cramer, Jayashree ; Kim, Sang J. ; Chiang, Michael. / A Quantitative Severity Scale for Retinopathy of Prematurity Using Deep Learning to Monitor Disease Regression after Treatment. In: JAMA ophthalmology. 2019.
@article{0cec12f0aebb4f7f9081f238d1b8b9a6,
title = "A Quantitative Severity Scale for Retinopathy of Prematurity Using Deep Learning to Monitor Disease Regression after Treatment",
abstract = "Importance: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide, but treatment failure and disease recurrence are important causes of adverse outcomes in patients with treatment-requiring ROP (TR-ROP). Objectives: To apply an automated ROP vascular severity score obtained using a deep learning algorithm and to assess its utility for objectively monitoring ROP regression after treatment. Design, Setting, and Participants: This retrospective cohort study used data from the Imaging and Informatics in ROP consortium, which comprises 9 tertiary referral centers in North America that screen high volumes of at-risk infants for ROP. Images of 5255 clinical eye examinations from 871 infants performed between July 2011 and December 2016 were assessed for eligibility in the present study. The disease course was assessed with time across the numerous examinations for patients with TR-ROP. Infants born prematurely meeting screening criteria for ROP who developed TR-ROP and who had images captured within 4 weeks before and after treatment as well as at the time of treatment were included. Main Outcomes and Measures: The primary outcome was mean (SD) ROP vascular severity score before, at time of, and after treatment. A deep learning classifier was used to assign a continuous ROP vascular severity score, which ranged from 1 (normal) to 9 (most severe), at each examination. A secondary outcome was the difference in ROP vascular severity score among eyes treated with laser or the vascular endothelial growth factor antagonist bevacizumab. Differences between groups for both outcomes were assessed using unpaired 2-tailed t tests with Bonferroni correction. Results: Of 5255 examined eyes, 91 developed TR-ROP, of which 46 eyes met the inclusion criteria based on the available images. The mean (SD) birth weight of those patients was 653 (185) g, with a mean (SD) gestational age of 24.9 (1.3) weeks. The mean (SD) ROP vascular severity scores significantly increased 2 weeks prior to treatment (4.19 [1.75]), peaked at treatment (7.43 [1.89]), and decreased for at least 2 weeks after treatment (4.00 [1.88]) (all P <.001). Eyes requiring retreatment with laser had higher ROP vascular severity scores at the time of initial treatment compared with eyes receiving a single treatment (P <.001). Conclusions and Relevance: This quantitative ROP vascular severity score appears to consistently reflect clinical disease progression and posttreatment regression in eyes with TR-ROP. These study results may have implications for the monitoring of patients with ROP for treatment failure and disease recurrence and for determining the appropriate level of disease severity for primary treatment in eyes with aggressive disease.",
author = "Kishan Gupta and John Campbell and Stanford Taylor and Brown, {James M.} and Susan Ostmo and Chan, {R. V.Paul} and Jennifer Dy and Deniz Erdogmus and Stratis Ioannidis and Jayashree Kalpathy-Cramer and Kim, {Sang J.} and Michael Chiang",
year = "2019",
month = "1",
day = "1",
doi = "10.1001/jamaophthalmol.2019.2442",
language = "English (US)",
journal = "JAMA Ophthalmology",
issn = "2168-6165",
publisher = "American Medical Association",

}

TY - JOUR

T1 - A Quantitative Severity Scale for Retinopathy of Prematurity Using Deep Learning to Monitor Disease Regression after Treatment

AU - Gupta, Kishan

AU - Campbell, John

AU - Taylor, Stanford

AU - Brown, James M.

AU - Ostmo, Susan

AU - Chan, R. V.Paul

AU - Dy, Jennifer

AU - Erdogmus, Deniz

AU - Ioannidis, Stratis

AU - Kalpathy-Cramer, Jayashree

AU - Kim, Sang J.

AU - Chiang, Michael

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Importance: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide, but treatment failure and disease recurrence are important causes of adverse outcomes in patients with treatment-requiring ROP (TR-ROP). Objectives: To apply an automated ROP vascular severity score obtained using a deep learning algorithm and to assess its utility for objectively monitoring ROP regression after treatment. Design, Setting, and Participants: This retrospective cohort study used data from the Imaging and Informatics in ROP consortium, which comprises 9 tertiary referral centers in North America that screen high volumes of at-risk infants for ROP. Images of 5255 clinical eye examinations from 871 infants performed between July 2011 and December 2016 were assessed for eligibility in the present study. The disease course was assessed with time across the numerous examinations for patients with TR-ROP. Infants born prematurely meeting screening criteria for ROP who developed TR-ROP and who had images captured within 4 weeks before and after treatment as well as at the time of treatment were included. Main Outcomes and Measures: The primary outcome was mean (SD) ROP vascular severity score before, at time of, and after treatment. A deep learning classifier was used to assign a continuous ROP vascular severity score, which ranged from 1 (normal) to 9 (most severe), at each examination. A secondary outcome was the difference in ROP vascular severity score among eyes treated with laser or the vascular endothelial growth factor antagonist bevacizumab. Differences between groups for both outcomes were assessed using unpaired 2-tailed t tests with Bonferroni correction. Results: Of 5255 examined eyes, 91 developed TR-ROP, of which 46 eyes met the inclusion criteria based on the available images. The mean (SD) birth weight of those patients was 653 (185) g, with a mean (SD) gestational age of 24.9 (1.3) weeks. The mean (SD) ROP vascular severity scores significantly increased 2 weeks prior to treatment (4.19 [1.75]), peaked at treatment (7.43 [1.89]), and decreased for at least 2 weeks after treatment (4.00 [1.88]) (all P <.001). Eyes requiring retreatment with laser had higher ROP vascular severity scores at the time of initial treatment compared with eyes receiving a single treatment (P <.001). Conclusions and Relevance: This quantitative ROP vascular severity score appears to consistently reflect clinical disease progression and posttreatment regression in eyes with TR-ROP. These study results may have implications for the monitoring of patients with ROP for treatment failure and disease recurrence and for determining the appropriate level of disease severity for primary treatment in eyes with aggressive disease.

AB - Importance: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness worldwide, but treatment failure and disease recurrence are important causes of adverse outcomes in patients with treatment-requiring ROP (TR-ROP). Objectives: To apply an automated ROP vascular severity score obtained using a deep learning algorithm and to assess its utility for objectively monitoring ROP regression after treatment. Design, Setting, and Participants: This retrospective cohort study used data from the Imaging and Informatics in ROP consortium, which comprises 9 tertiary referral centers in North America that screen high volumes of at-risk infants for ROP. Images of 5255 clinical eye examinations from 871 infants performed between July 2011 and December 2016 were assessed for eligibility in the present study. The disease course was assessed with time across the numerous examinations for patients with TR-ROP. Infants born prematurely meeting screening criteria for ROP who developed TR-ROP and who had images captured within 4 weeks before and after treatment as well as at the time of treatment were included. Main Outcomes and Measures: The primary outcome was mean (SD) ROP vascular severity score before, at time of, and after treatment. A deep learning classifier was used to assign a continuous ROP vascular severity score, which ranged from 1 (normal) to 9 (most severe), at each examination. A secondary outcome was the difference in ROP vascular severity score among eyes treated with laser or the vascular endothelial growth factor antagonist bevacizumab. Differences between groups for both outcomes were assessed using unpaired 2-tailed t tests with Bonferroni correction. Results: Of 5255 examined eyes, 91 developed TR-ROP, of which 46 eyes met the inclusion criteria based on the available images. The mean (SD) birth weight of those patients was 653 (185) g, with a mean (SD) gestational age of 24.9 (1.3) weeks. The mean (SD) ROP vascular severity scores significantly increased 2 weeks prior to treatment (4.19 [1.75]), peaked at treatment (7.43 [1.89]), and decreased for at least 2 weeks after treatment (4.00 [1.88]) (all P <.001). Eyes requiring retreatment with laser had higher ROP vascular severity scores at the time of initial treatment compared with eyes receiving a single treatment (P <.001). Conclusions and Relevance: This quantitative ROP vascular severity score appears to consistently reflect clinical disease progression and posttreatment regression in eyes with TR-ROP. These study results may have implications for the monitoring of patients with ROP for treatment failure and disease recurrence and for determining the appropriate level of disease severity for primary treatment in eyes with aggressive disease.

UR - http://www.scopus.com/inward/record.url?scp=85068521502&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068521502&partnerID=8YFLogxK

U2 - 10.1001/jamaophthalmol.2019.2442

DO - 10.1001/jamaophthalmol.2019.2442

M3 - Article

JO - JAMA Ophthalmology

JF - JAMA Ophthalmology

SN - 2168-6165

ER -