Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality

Andong Cao, Ali Dhanaliwala, Jianbo Shi, Terence P. Gade, Brian J. Park

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Augmented reality (AR) can enable physicians to "see" inside of patients by projecting cross-sectional imaging directly onto the patient during procedures. In order to maintain workflow, imaging must be quickly and accurately registered to the patient. We describe a method for automatically registering a CT image set projected from an augmented reality headset to a set of points in the real world as a first step towards real-time registration of medical images to patients. Sterile, radiopaque fiducial markers with unique optical identifiers were placed on a patient prior to acquiring a CT scan of the abdomen. For testing purposes, the same fiducial markers were then placed on a tabletop as a representation of the patient. Our algorithm then automatically located the fiducial markers in the CT image set, optically identified the fiducial markers on the tabletop, registered the markers in the CT image set with the optically detected markers and finally projected the registered CT image set onto the real-world markers using the augmented reality headset.The registration time for aligning the image set using 3 markers was 0.9 ± 0.2 seconds with an accuracy of 5 ± 2 mm. These findings demonstrate the feasibility of fast and accurate registration using unique radiopaque markers for aligning patient imaging onto patients for procedural planning and guidance.

Original languageEnglish (US)
Title of host publicationMedical Imaging 2020
Subtitle of host publicationImaging Informatics for Healthcare, Research, and Applications
EditorsPo-Hao Chen, Thomas M. Deserno
PublisherSPIE
ISBN (Electronic)9781510634039
DOIs
StatePublished - 2020
Externally publishedYes
EventMedical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications - Houston, United States
Duration: Feb 16 2020Feb 17 2020

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11318
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications
CountryUnited States
CityHouston
Period2/16/202/17/20

Keywords

  • Augmented Reality
  • Computer Vision
  • Interventional Radiology
  • Mixed Reality
  • Registration

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Biomaterials
  • Atomic and Molecular Physics, and Optics
  • Radiology Nuclear Medicine and imaging

Fingerprint Dive into the research topics of 'Image-based marker tracking and registration for intraoperative 3D image-guided interventions using augmented reality'. Together they form a unique fingerprint.

Cite this