Interobserver agreement of confocal laser endomicroscopy for bladder cancer.

Timothy C. Chang, Jen-Jane Liu, Shelly T. Hsiao, Ying Pan, Kathleen E. Mach, John T. Leppert, Jesse K. McKenney, Robert V. Rouse, Joseph C. Liao

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

Emerging optical imaging technologies such as confocal laser endomicroscopy (CLE) hold promise in improving bladder cancer diagnosis. The purpose of this study was to determine the interobserver agreement of image interpretation using CLE for bladder cancer. Experienced CLE urologists (n=2), novice CLE urologists (n=6), pathologists (n=4), and nonclinical researchers (n=5) were recruited to participate in a 2-hour computer-based training consisting of a teaching and validation set of intraoperative white light cystoscopy (WLC) and CLE video sequences from patients undergoing transurethral resection of bladder tumor. Interobserver agreement was determined using the κ statistic. Of the 31 bladder regions analyzed, 19 were cancer and 12 were benign. For cancer diagnosis, experienced CLE urologists had substantial agreement for both CLE and WLC+CLE (90%, κ 0.80) compared with moderate agreement for WLC alone (74%, κ 0.46), while novice CLE urologists had moderate agreement for CLE (77%, κ 0.55), WLC (78%, κ 0.54), and WLC+CLE (80%, κ 0.59). Pathologists had substantial agreement for CLE (81%, κ 0.61), and nonclinical researchers had moderate agreement (77%, κ 0.49) in cancer diagnosis. For cancer grading, experienced CLE urologists had fair to moderate agreement for CLE (68%, κ 0.64), WLC (74%, κ 0.67), and WLC+CLE (53%, κ 0.33), as did novice CLE urologists for CLE (53%, κ 0.39), WLC (66%, κ 0.50), and WLC+CLE (61%, κ 0.49). Pathologists (65%, κ 0.55) and nonclinical researchers (61%, κ 0.56) both had moderate agreement for CLE in cancer grading. CLE is an adoptable technology for cancer diagnosis in novice CLE observers after a short training with moderate interobserver agreement and diagnostic accuracy similar to WLC alone. Experienced CLE observers may be capable of achieving substantial levels of agreement for cancer diagnosis that is higher than with WLC alone.

Original languageEnglish (US)
Pages (from-to)598-603
Number of pages6
JournalJournal of Endourology
Volume27
Issue number5
DOIs
StatePublished - May 2013
Externally publishedYes

Fingerprint

Urinary Bladder Neoplasms
Lasers
Cystoscopy
Light
Neoplasms
Research Personnel
Technology
Optical Imaging

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Chang, T. C., Liu, J-J., Hsiao, S. T., Pan, Y., Mach, K. E., Leppert, J. T., ... Liao, J. C. (2013). Interobserver agreement of confocal laser endomicroscopy for bladder cancer. Journal of Endourology, 27(5), 598-603. https://doi.org/10.1089/end.2012.0549

Interobserver agreement of confocal laser endomicroscopy for bladder cancer. / Chang, Timothy C.; Liu, Jen-Jane; Hsiao, Shelly T.; Pan, Ying; Mach, Kathleen E.; Leppert, John T.; McKenney, Jesse K.; Rouse, Robert V.; Liao, Joseph C.

In: Journal of Endourology, Vol. 27, No. 5, 05.2013, p. 598-603.

Research output: Contribution to journalArticle

Chang, TC, Liu, J-J, Hsiao, ST, Pan, Y, Mach, KE, Leppert, JT, McKenney, JK, Rouse, RV & Liao, JC 2013, 'Interobserver agreement of confocal laser endomicroscopy for bladder cancer.', Journal of Endourology, vol. 27, no. 5, pp. 598-603. https://doi.org/10.1089/end.2012.0549
Chang, Timothy C. ; Liu, Jen-Jane ; Hsiao, Shelly T. ; Pan, Ying ; Mach, Kathleen E. ; Leppert, John T. ; McKenney, Jesse K. ; Rouse, Robert V. ; Liao, Joseph C. / Interobserver agreement of confocal laser endomicroscopy for bladder cancer. In: Journal of Endourology. 2013 ; Vol. 27, No. 5. pp. 598-603.
@article{efaf6ff9a41b446b9e06944e3dcda20c,
title = "Interobserver agreement of confocal laser endomicroscopy for bladder cancer.",
abstract = "Emerging optical imaging technologies such as confocal laser endomicroscopy (CLE) hold promise in improving bladder cancer diagnosis. The purpose of this study was to determine the interobserver agreement of image interpretation using CLE for bladder cancer. Experienced CLE urologists (n=2), novice CLE urologists (n=6), pathologists (n=4), and nonclinical researchers (n=5) were recruited to participate in a 2-hour computer-based training consisting of a teaching and validation set of intraoperative white light cystoscopy (WLC) and CLE video sequences from patients undergoing transurethral resection of bladder tumor. Interobserver agreement was determined using the κ statistic. Of the 31 bladder regions analyzed, 19 were cancer and 12 were benign. For cancer diagnosis, experienced CLE urologists had substantial agreement for both CLE and WLC+CLE (90{\%}, κ 0.80) compared with moderate agreement for WLC alone (74{\%}, κ 0.46), while novice CLE urologists had moderate agreement for CLE (77{\%}, κ 0.55), WLC (78{\%}, κ 0.54), and WLC+CLE (80{\%}, κ 0.59). Pathologists had substantial agreement for CLE (81{\%}, κ 0.61), and nonclinical researchers had moderate agreement (77{\%}, κ 0.49) in cancer diagnosis. For cancer grading, experienced CLE urologists had fair to moderate agreement for CLE (68{\%}, κ 0.64), WLC (74{\%}, κ 0.67), and WLC+CLE (53{\%}, κ 0.33), as did novice CLE urologists for CLE (53{\%}, κ 0.39), WLC (66{\%}, κ 0.50), and WLC+CLE (61{\%}, κ 0.49). Pathologists (65{\%}, κ 0.55) and nonclinical researchers (61{\%}, κ 0.56) both had moderate agreement for CLE in cancer grading. CLE is an adoptable technology for cancer diagnosis in novice CLE observers after a short training with moderate interobserver agreement and diagnostic accuracy similar to WLC alone. Experienced CLE observers may be capable of achieving substantial levels of agreement for cancer diagnosis that is higher than with WLC alone.",
author = "Chang, {Timothy C.} and Jen-Jane Liu and Hsiao, {Shelly T.} and Ying Pan and Mach, {Kathleen E.} and Leppert, {John T.} and McKenney, {Jesse K.} and Rouse, {Robert V.} and Liao, {Joseph C.}",
year = "2013",
month = "5",
doi = "10.1089/end.2012.0549",
language = "English (US)",
volume = "27",
pages = "598--603",
journal = "Journal of Endourology",
issn = "0892-7790",
publisher = "Mary Ann Liebert Inc.",
number = "5",

}

TY - JOUR

T1 - Interobserver agreement of confocal laser endomicroscopy for bladder cancer.

AU - Chang, Timothy C.

AU - Liu, Jen-Jane

AU - Hsiao, Shelly T.

AU - Pan, Ying

AU - Mach, Kathleen E.

AU - Leppert, John T.

AU - McKenney, Jesse K.

AU - Rouse, Robert V.

AU - Liao, Joseph C.

PY - 2013/5

Y1 - 2013/5

N2 - Emerging optical imaging technologies such as confocal laser endomicroscopy (CLE) hold promise in improving bladder cancer diagnosis. The purpose of this study was to determine the interobserver agreement of image interpretation using CLE for bladder cancer. Experienced CLE urologists (n=2), novice CLE urologists (n=6), pathologists (n=4), and nonclinical researchers (n=5) were recruited to participate in a 2-hour computer-based training consisting of a teaching and validation set of intraoperative white light cystoscopy (WLC) and CLE video sequences from patients undergoing transurethral resection of bladder tumor. Interobserver agreement was determined using the κ statistic. Of the 31 bladder regions analyzed, 19 were cancer and 12 were benign. For cancer diagnosis, experienced CLE urologists had substantial agreement for both CLE and WLC+CLE (90%, κ 0.80) compared with moderate agreement for WLC alone (74%, κ 0.46), while novice CLE urologists had moderate agreement for CLE (77%, κ 0.55), WLC (78%, κ 0.54), and WLC+CLE (80%, κ 0.59). Pathologists had substantial agreement for CLE (81%, κ 0.61), and nonclinical researchers had moderate agreement (77%, κ 0.49) in cancer diagnosis. For cancer grading, experienced CLE urologists had fair to moderate agreement for CLE (68%, κ 0.64), WLC (74%, κ 0.67), and WLC+CLE (53%, κ 0.33), as did novice CLE urologists for CLE (53%, κ 0.39), WLC (66%, κ 0.50), and WLC+CLE (61%, κ 0.49). Pathologists (65%, κ 0.55) and nonclinical researchers (61%, κ 0.56) both had moderate agreement for CLE in cancer grading. CLE is an adoptable technology for cancer diagnosis in novice CLE observers after a short training with moderate interobserver agreement and diagnostic accuracy similar to WLC alone. Experienced CLE observers may be capable of achieving substantial levels of agreement for cancer diagnosis that is higher than with WLC alone.

AB - Emerging optical imaging technologies such as confocal laser endomicroscopy (CLE) hold promise in improving bladder cancer diagnosis. The purpose of this study was to determine the interobserver agreement of image interpretation using CLE for bladder cancer. Experienced CLE urologists (n=2), novice CLE urologists (n=6), pathologists (n=4), and nonclinical researchers (n=5) were recruited to participate in a 2-hour computer-based training consisting of a teaching and validation set of intraoperative white light cystoscopy (WLC) and CLE video sequences from patients undergoing transurethral resection of bladder tumor. Interobserver agreement was determined using the κ statistic. Of the 31 bladder regions analyzed, 19 were cancer and 12 were benign. For cancer diagnosis, experienced CLE urologists had substantial agreement for both CLE and WLC+CLE (90%, κ 0.80) compared with moderate agreement for WLC alone (74%, κ 0.46), while novice CLE urologists had moderate agreement for CLE (77%, κ 0.55), WLC (78%, κ 0.54), and WLC+CLE (80%, κ 0.59). Pathologists had substantial agreement for CLE (81%, κ 0.61), and nonclinical researchers had moderate agreement (77%, κ 0.49) in cancer diagnosis. For cancer grading, experienced CLE urologists had fair to moderate agreement for CLE (68%, κ 0.64), WLC (74%, κ 0.67), and WLC+CLE (53%, κ 0.33), as did novice CLE urologists for CLE (53%, κ 0.39), WLC (66%, κ 0.50), and WLC+CLE (61%, κ 0.49). Pathologists (65%, κ 0.55) and nonclinical researchers (61%, κ 0.56) both had moderate agreement for CLE in cancer grading. CLE is an adoptable technology for cancer diagnosis in novice CLE observers after a short training with moderate interobserver agreement and diagnostic accuracy similar to WLC alone. Experienced CLE observers may be capable of achieving substantial levels of agreement for cancer diagnosis that is higher than with WLC alone.

UR - http://www.scopus.com/inward/record.url?scp=84885901103&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885901103&partnerID=8YFLogxK

U2 - 10.1089/end.2012.0549

DO - 10.1089/end.2012.0549

M3 - Article

VL - 27

SP - 598

EP - 603

JO - Journal of Endourology

JF - Journal of Endourology

SN - 0892-7790

IS - 5

ER -