From voxels to knowledge

A practical guide to the segmentation of complex electron microscopy 3D-data

Wen Ting Tsai, Ahmed Hassan, Purbasha Sarkar, Joaquin Correa, Zoltan Metlagel, Danielle Jorgens, Manfred Auer

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Modern 3D electron microscopy approaches have recently allowed unprecedented insight into the 3D ultrastructural organization of cells and tissues, enabling the visualization of large macromolecular machines, such as adhesion complexes, as well as higher-order structures, such as the cytoskeleton and cellular organelles in their respective cell and tissue context. Given the inherent complexity of cellular volumes, it is essential to first extract the features of interest in order to allow visualization, quantification, and therefore comprehension of their 3D organization. Each data set is defined by distinct characteristics, e.g., signal-to-noise ratio, crispness (sharpness) of the data, heterogeneity of its features, crowdedness of features, presence or absence of characteristic shapes that allow for easy identification, and the percentage of the entire volume that a specific region of interest occupies. All these characteristics need to be considered when deciding on which approach to take for segmentation. The six different 3D ultrastructural data sets presented were obtained by three different imaging approaches: resin embedded stained electron tomography, focused ion beam- and serial block face- scanning electron microscopy (FIB-SEM, SBF-SEM) of mildly stained and heavily stained samples, respectively. For these data sets, four different segmentation approaches have been applied: (1) fully manual model building followed solely by visualization of the model, (2) manual tracing segmentation of the data followed by surface rendering, (3) semi-automated approaches followed by surface rendering, or (4) automated custom-designed segmentation algorithms followed by surface rendering and quantitative analysis. Depending on the combination of data set characteristics, it was found that typically one of these four categorical approaches outperforms the others, but depending on the exact sequence of criteria, more than one approach may be successful. Based on these data, we propose a triage scheme that categorizes both objective data set characteristics and subjective personal criteria for the analysis of the different data sets.

Original languageEnglish (US)
Article numbere51673
JournalJournal of Visualized Experiments
Issue number90
DOIs
StatePublished - Aug 13 2014
Externally publishedYes

Fingerprint

Electron microscopy
Electron Microscopy
Visualization
Scanning electron microscopy
Tissue
Focused ion beams
Tomography
Signal to noise ratio
Adhesion
Resins
Electron Microscope Tomography
Imaging techniques
Electrons
Triage
Signal-To-Noise Ratio
Cytoskeleton
Chemical analysis
Organelles
Electron Scanning Microscopy
Datasets

Keywords

  • 3D electron microscopy
  • Bioengineering
  • Feature extraction
  • Image analysis
  • Issue 90
  • Manual tracing
  • Reconstruction
  • Segmentation
  • Thresholding

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Chemical Engineering(all)
  • Immunology and Microbiology(all)
  • Neuroscience(all)
  • Medicine(all)

Cite this

Tsai, W. T., Hassan, A., Sarkar, P., Correa, J., Metlagel, Z., Jorgens, D., & Auer, M. (2014). From voxels to knowledge: A practical guide to the segmentation of complex electron microscopy 3D-data. Journal of Visualized Experiments, (90), [e51673]. https://doi.org/10.3791/51673

From voxels to knowledge : A practical guide to the segmentation of complex electron microscopy 3D-data. / Tsai, Wen Ting; Hassan, Ahmed; Sarkar, Purbasha; Correa, Joaquin; Metlagel, Zoltan; Jorgens, Danielle; Auer, Manfred.

In: Journal of Visualized Experiments, No. 90, e51673, 13.08.2014.

Research output: Contribution to journalArticle

Tsai, Wen Ting ; Hassan, Ahmed ; Sarkar, Purbasha ; Correa, Joaquin ; Metlagel, Zoltan ; Jorgens, Danielle ; Auer, Manfred. / From voxels to knowledge : A practical guide to the segmentation of complex electron microscopy 3D-data. In: Journal of Visualized Experiments. 2014 ; No. 90.
@article{6fddc78f02d346ddb17f38141135cad9,
title = "From voxels to knowledge: A practical guide to the segmentation of complex electron microscopy 3D-data",
abstract = "Modern 3D electron microscopy approaches have recently allowed unprecedented insight into the 3D ultrastructural organization of cells and tissues, enabling the visualization of large macromolecular machines, such as adhesion complexes, as well as higher-order structures, such as the cytoskeleton and cellular organelles in their respective cell and tissue context. Given the inherent complexity of cellular volumes, it is essential to first extract the features of interest in order to allow visualization, quantification, and therefore comprehension of their 3D organization. Each data set is defined by distinct characteristics, e.g., signal-to-noise ratio, crispness (sharpness) of the data, heterogeneity of its features, crowdedness of features, presence or absence of characteristic shapes that allow for easy identification, and the percentage of the entire volume that a specific region of interest occupies. All these characteristics need to be considered when deciding on which approach to take for segmentation. The six different 3D ultrastructural data sets presented were obtained by three different imaging approaches: resin embedded stained electron tomography, focused ion beam- and serial block face- scanning electron microscopy (FIB-SEM, SBF-SEM) of mildly stained and heavily stained samples, respectively. For these data sets, four different segmentation approaches have been applied: (1) fully manual model building followed solely by visualization of the model, (2) manual tracing segmentation of the data followed by surface rendering, (3) semi-automated approaches followed by surface rendering, or (4) automated custom-designed segmentation algorithms followed by surface rendering and quantitative analysis. Depending on the combination of data set characteristics, it was found that typically one of these four categorical approaches outperforms the others, but depending on the exact sequence of criteria, more than one approach may be successful. Based on these data, we propose a triage scheme that categorizes both objective data set characteristics and subjective personal criteria for the analysis of the different data sets.",
keywords = "3D electron microscopy, Bioengineering, Feature extraction, Image analysis, Issue 90, Manual tracing, Reconstruction, Segmentation, Thresholding",
author = "Tsai, {Wen Ting} and Ahmed Hassan and Purbasha Sarkar and Joaquin Correa and Zoltan Metlagel and Danielle Jorgens and Manfred Auer",
year = "2014",
month = "8",
day = "13",
doi = "10.3791/51673",
language = "English (US)",
journal = "Journal of visualized experiments : JoVE",
issn = "1940-087X",
publisher = "MYJoVE Corporation",
number = "90",

}

TY - JOUR

T1 - From voxels to knowledge

T2 - A practical guide to the segmentation of complex electron microscopy 3D-data

AU - Tsai, Wen Ting

AU - Hassan, Ahmed

AU - Sarkar, Purbasha

AU - Correa, Joaquin

AU - Metlagel, Zoltan

AU - Jorgens, Danielle

AU - Auer, Manfred

PY - 2014/8/13

Y1 - 2014/8/13

N2 - Modern 3D electron microscopy approaches have recently allowed unprecedented insight into the 3D ultrastructural organization of cells and tissues, enabling the visualization of large macromolecular machines, such as adhesion complexes, as well as higher-order structures, such as the cytoskeleton and cellular organelles in their respective cell and tissue context. Given the inherent complexity of cellular volumes, it is essential to first extract the features of interest in order to allow visualization, quantification, and therefore comprehension of their 3D organization. Each data set is defined by distinct characteristics, e.g., signal-to-noise ratio, crispness (sharpness) of the data, heterogeneity of its features, crowdedness of features, presence or absence of characteristic shapes that allow for easy identification, and the percentage of the entire volume that a specific region of interest occupies. All these characteristics need to be considered when deciding on which approach to take for segmentation. The six different 3D ultrastructural data sets presented were obtained by three different imaging approaches: resin embedded stained electron tomography, focused ion beam- and serial block face- scanning electron microscopy (FIB-SEM, SBF-SEM) of mildly stained and heavily stained samples, respectively. For these data sets, four different segmentation approaches have been applied: (1) fully manual model building followed solely by visualization of the model, (2) manual tracing segmentation of the data followed by surface rendering, (3) semi-automated approaches followed by surface rendering, or (4) automated custom-designed segmentation algorithms followed by surface rendering and quantitative analysis. Depending on the combination of data set characteristics, it was found that typically one of these four categorical approaches outperforms the others, but depending on the exact sequence of criteria, more than one approach may be successful. Based on these data, we propose a triage scheme that categorizes both objective data set characteristics and subjective personal criteria for the analysis of the different data sets.

AB - Modern 3D electron microscopy approaches have recently allowed unprecedented insight into the 3D ultrastructural organization of cells and tissues, enabling the visualization of large macromolecular machines, such as adhesion complexes, as well as higher-order structures, such as the cytoskeleton and cellular organelles in their respective cell and tissue context. Given the inherent complexity of cellular volumes, it is essential to first extract the features of interest in order to allow visualization, quantification, and therefore comprehension of their 3D organization. Each data set is defined by distinct characteristics, e.g., signal-to-noise ratio, crispness (sharpness) of the data, heterogeneity of its features, crowdedness of features, presence or absence of characteristic shapes that allow for easy identification, and the percentage of the entire volume that a specific region of interest occupies. All these characteristics need to be considered when deciding on which approach to take for segmentation. The six different 3D ultrastructural data sets presented were obtained by three different imaging approaches: resin embedded stained electron tomography, focused ion beam- and serial block face- scanning electron microscopy (FIB-SEM, SBF-SEM) of mildly stained and heavily stained samples, respectively. For these data sets, four different segmentation approaches have been applied: (1) fully manual model building followed solely by visualization of the model, (2) manual tracing segmentation of the data followed by surface rendering, (3) semi-automated approaches followed by surface rendering, or (4) automated custom-designed segmentation algorithms followed by surface rendering and quantitative analysis. Depending on the combination of data set characteristics, it was found that typically one of these four categorical approaches outperforms the others, but depending on the exact sequence of criteria, more than one approach may be successful. Based on these data, we propose a triage scheme that categorizes both objective data set characteristics and subjective personal criteria for the analysis of the different data sets.

KW - 3D electron microscopy

KW - Bioengineering

KW - Feature extraction

KW - Image analysis

KW - Issue 90

KW - Manual tracing

KW - Reconstruction

KW - Segmentation

KW - Thresholding

UR - http://www.scopus.com/inward/record.url?scp=84906351137&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84906351137&partnerID=8YFLogxK

U2 - 10.3791/51673

DO - 10.3791/51673

M3 - Article

JO - Journal of visualized experiments : JoVE

JF - Journal of visualized experiments : JoVE

SN - 1940-087X

IS - 90

M1 - e51673

ER -