Learning-based local quality assessment of reflectance confocal microscopy images for dermatology applications

Miroslawa Sikorska, Andrzej Skalski, Marek Wodzinski, Alexander Witkowski, Giovanni Pellacani, Joanna Ludzik

Research output: Contribution to journalArticlepeer-review

Abstract

Background and objective: Skin cancer is one of the most common types of cancer and its early diagnosis significantly reduces patient morbidity and mortality. Reflectance confocal microscopy (RCM) is a modern and non-invasive method of diagnosis that is becoming popular amongst clinical dermatologists. The frequent occurrence of artifacts in the images is one of the most challenging factors in making a diagnosis based on RCM. It impedes the diagnosis process for the dermatologist and makes its automation difficult. In this work, we employ artificial neural networks to propose a local quality assessment system. It allows for the detection of artifacts and non-informative component images both retrospectively or in real-time during the examination. Methods: In this research we address the quality assessment issue by proposing an artificial intelligence-based solution. 612 RCM mosaics were divided into small component images and manually classified in order to train the ResNeXt model in the quality verification context. A trained network was used to create an application that marks individual classes of the component images on the mosaic. Results: We achieved the average classification precision of 0.98 both for the validation and test data sets. In addition, we present local quality assessment statistics of the 1540 cases of skin lesions to show which types of skin lesions most often present with artifacts in their RCM images. Conclusions: In this research we investigate the utility of the deep convolution neural networks for the local quality assessment of the RCM images. We propose an AI-based system that may be effectively used as real-time support for the dermatologist during a RCM examination and as a base for the automation of the diagnostic process.

Original languageEnglish (US)
Pages (from-to)880-890
Number of pages11
JournalBiocybernetics and Biomedical Engineering
Volume41
Issue number3
DOIs
StatePublished - Jul 1 2021

Keywords

  • Deep learning
  • Dermatology
  • Image artifact
  • RCM
  • Reflectance confocal microscopy
  • Skin lesions

ASJC Scopus subject areas

  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Learning-based local quality assessment of reflectance confocal microscopy images for dermatology applications'. Together they form a unique fingerprint.

Cite this