Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks

Sourabh Kulhare, Xinliang Zheng, Courosh Mehanian, Cynthia Gregory, Meihua Zhu, Kenton Gregory, Hua Xie, James McAndrew Jones, Benjamin Wilson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Ultrasound imaging can be used to identify a variety of lung pathologies, including pneumonia, pneumothorax, pleural effusion, and acute respiratory distress syndrome (ARDS). Ultrasound lung images of sufficient quality are relatively easy to acquire, but can be difficult to interpret as the relevant features are mostly non-structural and require expert interpretation. In this work, we developed a convolutional neural network (CNN) algorithm to identify five key lung features linked to pathological lung conditions: B-lines, merged B-lines, lack of lung sliding, consolidation and pleural effusion. The algorithm was trained using short ultrasound videos of in vivo swine models with carefully controlled lung conditions. Key lung features were annotated by expert radiologists and snonographers. Pneumothorax (absence of lung sliding) was detected with an Inception V3 CNN using simulated M-mode images. A single shot detection (SSD) framework was used to detect the remaining features. Our results indicate that deep learning algorithms can successfully detect lung abnormalities in ultrasound imagery. Computer-assisted ultrasound interpretation can place expert-level diagnostic accuracy in the hands of low-resource health care providers.

Original languageEnglish (US)
Title of host publicationSimulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings
EditorsStephen Aylward, Amber Simpson, Lena Maier-Hein, Anne Martel, Matthieu Chabanas, João Manuel Tavares, Ingerid Reinertsen, Zeike Taylor, Yiming Xiao, Keyvan Farahani, Danail Stoyanov, Shuo Li, Hassan Rivaz
PublisherSpringer Verlag
Pages65-73
Number of pages9
ISBN (Print)9783030010447
DOIs
StatePublished - Jan 1 2018
EventInternational Workshop on Point-of-Care Ultrasound, POCUS 2018, the International Workshop on Bio-Imaging and Visualization for Patient-Customized Simulations, BIVPCS 2017, the International Workshop on Correction of Brainshift with Intra-Operative Ultrasound, CuRIOUS 2018, and the International Workshop on Computational Precision Medicine, CPM 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018 - Granada, Spain
Duration: Sep 16 2018Sep 20 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11042 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

OtherInternational Workshop on Point-of-Care Ultrasound, POCUS 2018, the International Workshop on Bio-Imaging and Visualization for Patient-Customized Simulations, BIVPCS 2017, the International Workshop on Correction of Brainshift with Intra-Operative Ultrasound, CuRIOUS 2018, and the International Workshop on Computational Precision Medicine, CPM 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018
CountrySpain
CityGranada
Period9/16/189/20/18

Fingerprint

Ultrasound
Lung
Ultrasonics
Neural Networks
Neural networks
Pathology
Health care
Consolidation
Learning algorithms
Diagnostic Accuracy
Imaging techniques
Line
Network Algorithms
Acute
Healthcare
Learning Algorithm
Imaging
Sufficient
Resources

Keywords

  • Convolutional neural networks
  • Deep learning
  • Lung ultrasound

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kulhare, S., Zheng, X., Mehanian, C., Gregory, C., Zhu, M., Gregory, K., ... Wilson, B. (2018). Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. In S. Aylward, A. Simpson, L. Maier-Hein, A. Martel, M. Chabanas, J. M. Tavares, I. Reinertsen, Z. Taylor, Y. Xiao, K. Farahani, D. Stoyanov, S. Li, ... H. Rivaz (Eds.), Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings (pp. 65-73). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11042 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-01045-4_8

Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. / Kulhare, Sourabh; Zheng, Xinliang; Mehanian, Courosh; Gregory, Cynthia; Zhu, Meihua; Gregory, Kenton; Xie, Hua; McAndrew Jones, James; Wilson, Benjamin.

Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings. ed. / Stephen Aylward; Amber Simpson; Lena Maier-Hein; Anne Martel; Matthieu Chabanas; João Manuel Tavares; Ingerid Reinertsen; Zeike Taylor; Yiming Xiao; Keyvan Farahani; Danail Stoyanov; Shuo Li; Hassan Rivaz. Springer Verlag, 2018. p. 65-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11042 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kulhare, S, Zheng, X, Mehanian, C, Gregory, C, Zhu, M, Gregory, K, Xie, H, McAndrew Jones, J & Wilson, B 2018, Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. in S Aylward, A Simpson, L Maier-Hein, A Martel, M Chabanas, JM Tavares, I Reinertsen, Z Taylor, Y Xiao, K Farahani, D Stoyanov, S Li & H Rivaz (eds), Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11042 LNCS, Springer Verlag, pp. 65-73, International Workshop on Point-of-Care Ultrasound, POCUS 2018, the International Workshop on Bio-Imaging and Visualization for Patient-Customized Simulations, BIVPCS 2017, the International Workshop on Correction of Brainshift with Intra-Operative Ultrasound, CuRIOUS 2018, and the International Workshop on Computational Precision Medicine, CPM 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018, Granada, Spain, 9/16/18. https://doi.org/10.1007/978-3-030-01045-4_8
Kulhare S, Zheng X, Mehanian C, Gregory C, Zhu M, Gregory K et al. Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. In Aylward S, Simpson A, Maier-Hein L, Martel A, Chabanas M, Tavares JM, Reinertsen I, Taylor Z, Xiao Y, Farahani K, Stoyanov D, Li S, Rivaz H, editors, Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings. Springer Verlag. 2018. p. 65-73. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-01045-4_8
Kulhare, Sourabh ; Zheng, Xinliang ; Mehanian, Courosh ; Gregory, Cynthia ; Zhu, Meihua ; Gregory, Kenton ; Xie, Hua ; McAndrew Jones, James ; Wilson, Benjamin. / Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks. Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings. editor / Stephen Aylward ; Amber Simpson ; Lena Maier-Hein ; Anne Martel ; Matthieu Chabanas ; João Manuel Tavares ; Ingerid Reinertsen ; Zeike Taylor ; Yiming Xiao ; Keyvan Farahani ; Danail Stoyanov ; Shuo Li ; Hassan Rivaz. Springer Verlag, 2018. pp. 65-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{124dc4ea0412451fa41e7d4664f6b3b4,
title = "Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks",
abstract = "Ultrasound imaging can be used to identify a variety of lung pathologies, including pneumonia, pneumothorax, pleural effusion, and acute respiratory distress syndrome (ARDS). Ultrasound lung images of sufficient quality are relatively easy to acquire, but can be difficult to interpret as the relevant features are mostly non-structural and require expert interpretation. In this work, we developed a convolutional neural network (CNN) algorithm to identify five key lung features linked to pathological lung conditions: B-lines, merged B-lines, lack of lung sliding, consolidation and pleural effusion. The algorithm was trained using short ultrasound videos of in vivo swine models with carefully controlled lung conditions. Key lung features were annotated by expert radiologists and snonographers. Pneumothorax (absence of lung sliding) was detected with an Inception V3 CNN using simulated M-mode images. A single shot detection (SSD) framework was used to detect the remaining features. Our results indicate that deep learning algorithms can successfully detect lung abnormalities in ultrasound imagery. Computer-assisted ultrasound interpretation can place expert-level diagnostic accuracy in the hands of low-resource health care providers.",
keywords = "Convolutional neural networks, Deep learning, Lung ultrasound",
author = "Sourabh Kulhare and Xinliang Zheng and Courosh Mehanian and Cynthia Gregory and Meihua Zhu and Kenton Gregory and Hua Xie and {McAndrew Jones}, James and Benjamin Wilson",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01045-4_8",
language = "English (US)",
isbn = "9783030010447",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "65--73",
editor = "Stephen Aylward and Amber Simpson and Lena Maier-Hein and Anne Martel and Matthieu Chabanas and Tavares, {Jo{\~a}o Manuel} and Ingerid Reinertsen and Zeike Taylor and Yiming Xiao and Keyvan Farahani and Danail Stoyanov and Shuo Li and Hassan Rivaz",
booktitle = "Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings",
address = "Germany",

}

TY - GEN

T1 - Ultrasound-based detection of lung abnormalities using single shot detection convolutional neural networks

AU - Kulhare, Sourabh

AU - Zheng, Xinliang

AU - Mehanian, Courosh

AU - Gregory, Cynthia

AU - Zhu, Meihua

AU - Gregory, Kenton

AU - Xie, Hua

AU - McAndrew Jones, James

AU - Wilson, Benjamin

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Ultrasound imaging can be used to identify a variety of lung pathologies, including pneumonia, pneumothorax, pleural effusion, and acute respiratory distress syndrome (ARDS). Ultrasound lung images of sufficient quality are relatively easy to acquire, but can be difficult to interpret as the relevant features are mostly non-structural and require expert interpretation. In this work, we developed a convolutional neural network (CNN) algorithm to identify five key lung features linked to pathological lung conditions: B-lines, merged B-lines, lack of lung sliding, consolidation and pleural effusion. The algorithm was trained using short ultrasound videos of in vivo swine models with carefully controlled lung conditions. Key lung features were annotated by expert radiologists and snonographers. Pneumothorax (absence of lung sliding) was detected with an Inception V3 CNN using simulated M-mode images. A single shot detection (SSD) framework was used to detect the remaining features. Our results indicate that deep learning algorithms can successfully detect lung abnormalities in ultrasound imagery. Computer-assisted ultrasound interpretation can place expert-level diagnostic accuracy in the hands of low-resource health care providers.

AB - Ultrasound imaging can be used to identify a variety of lung pathologies, including pneumonia, pneumothorax, pleural effusion, and acute respiratory distress syndrome (ARDS). Ultrasound lung images of sufficient quality are relatively easy to acquire, but can be difficult to interpret as the relevant features are mostly non-structural and require expert interpretation. In this work, we developed a convolutional neural network (CNN) algorithm to identify five key lung features linked to pathological lung conditions: B-lines, merged B-lines, lack of lung sliding, consolidation and pleural effusion. The algorithm was trained using short ultrasound videos of in vivo swine models with carefully controlled lung conditions. Key lung features were annotated by expert radiologists and snonographers. Pneumothorax (absence of lung sliding) was detected with an Inception V3 CNN using simulated M-mode images. A single shot detection (SSD) framework was used to detect the remaining features. Our results indicate that deep learning algorithms can successfully detect lung abnormalities in ultrasound imagery. Computer-assisted ultrasound interpretation can place expert-level diagnostic accuracy in the hands of low-resource health care providers.

KW - Convolutional neural networks

KW - Deep learning

KW - Lung ultrasound

UR - http://www.scopus.com/inward/record.url?scp=85054392404&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054392404&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01045-4_8

DO - 10.1007/978-3-030-01045-4_8

M3 - Conference contribution

SN - 9783030010447

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 65

EP - 73

BT - Simulation, Image Processing, and Ultrasound Systems for Assisted Diagnosis and Navigation - International Workshops, POCUS 2018, BIVPCS 2018, CuRIOUS 2018, and CPM 2018, Held in Conjunction with MICCAI 2018, Proceedings

A2 - Aylward, Stephen

A2 - Simpson, Amber

A2 - Maier-Hein, Lena

A2 - Martel, Anne

A2 - Chabanas, Matthieu

A2 - Tavares, João Manuel

A2 - Reinertsen, Ingerid

A2 - Taylor, Zeike

A2 - Xiao, Yiming

A2 - Farahani, Keyvan

A2 - Stoyanov, Danail

A2 - Li, Shuo

A2 - Rivaz, Hassan

PB - Springer Verlag

ER -