Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery

Edward D. Mccoul, Timothy Smith, Jess C. Mace, Vijay K. Anand, Brent A. Senior, Peter H. Hwang, James A. Stankiewicz, Abtin Tabaee

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

Background: Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery. Methods: Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (Kf) and the prevalence- and bias-adjusted kappa (PABAK). Results: There were no significant correlations between age, Lund-Mackay score, or SNOT-22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (Kf = 0.886); moderate for the assessments of middle turbinate (MT) integrity (Kf = 0.543), MT position (Kf = 0.443), maxillary sinus patency (Kf = 0.593), and ethmoid sinus patency (Kf = 0.429); fair for discharge (Kf = 0.314), synechiae (Kf = 0.257), and middle meatus patency (Kf = 0.229); and poor for MT mucosal changes (Kf = 0.148) and uncinate process (Kf = 0.126). Conclusion: This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice.

Original languageEnglish (US)
Pages (from-to)453-459
Number of pages7
JournalInternational Forum of Allergy and Rhinology
Volume2
Issue number6
DOIs
StatePublished - Nov 2012

Fingerprint

Nose
Turbinates
Endoscopy
Ethmoid Sinus
Maxillary Sinus
Polyps
Software
Tomography

Keywords

  • Endoscopy
  • Interobserver variability
  • Paranasal sinuses
  • Rhinosinusitis
  • Surgery

ASJC Scopus subject areas

  • Immunology and Allergy
  • Otorhinolaryngology

Cite this

Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery. / Mccoul, Edward D.; Smith, Timothy; Mace, Jess C.; Anand, Vijay K.; Senior, Brent A.; Hwang, Peter H.; Stankiewicz, James A.; Tabaee, Abtin.

In: International Forum of Allergy and Rhinology, Vol. 2, No. 6, 11.2012, p. 453-459.

Research output: Contribution to journalArticle

Mccoul, Edward D. ; Smith, Timothy ; Mace, Jess C. ; Anand, Vijay K. ; Senior, Brent A. ; Hwang, Peter H. ; Stankiewicz, James A. ; Tabaee, Abtin. / Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery. In: International Forum of Allergy and Rhinology. 2012 ; Vol. 2, No. 6. pp. 453-459.
@article{b92c9c053d1341e5b62dbbe4c81d71ad,
title = "Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery",
abstract = "Background: Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery. Methods: Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (Kf) and the prevalence- and bias-adjusted kappa (PABAK). Results: There were no significant correlations between age, Lund-Mackay score, or SNOT-22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (Kf = 0.886); moderate for the assessments of middle turbinate (MT) integrity (Kf = 0.543), MT position (Kf = 0.443), maxillary sinus patency (Kf = 0.593), and ethmoid sinus patency (Kf = 0.429); fair for discharge (Kf = 0.314), synechiae (Kf = 0.257), and middle meatus patency (Kf = 0.229); and poor for MT mucosal changes (Kf = 0.148) and uncinate process (Kf = 0.126). Conclusion: This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice.",
keywords = "Endoscopy, Interobserver variability, Paranasal sinuses, Rhinosinusitis, Surgery",
author = "Mccoul, {Edward D.} and Timothy Smith and Mace, {Jess C.} and Anand, {Vijay K.} and Senior, {Brent A.} and Hwang, {Peter H.} and Stankiewicz, {James A.} and Abtin Tabaee",
year = "2012",
month = "11",
doi = "10.1002/alr.21058",
language = "English (US)",
volume = "2",
pages = "453--459",
journal = "International Forum of Allergy and Rhinology",
issn = "2042-6976",
publisher = "Wiley-Blackwell",
number = "6",

}

TY - JOUR

T1 - Interrater agreement of nasal endoscopy in patients with a prior history of endoscopic sinus surgery

AU - Mccoul, Edward D.

AU - Smith, Timothy

AU - Mace, Jess C.

AU - Anand, Vijay K.

AU - Senior, Brent A.

AU - Hwang, Peter H.

AU - Stankiewicz, James A.

AU - Tabaee, Abtin

PY - 2012/11

Y1 - 2012/11

N2 - Background: Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery. Methods: Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (Kf) and the prevalence- and bias-adjusted kappa (PABAK). Results: There were no significant correlations between age, Lund-Mackay score, or SNOT-22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (Kf = 0.886); moderate for the assessments of middle turbinate (MT) integrity (Kf = 0.543), MT position (Kf = 0.443), maxillary sinus patency (Kf = 0.593), and ethmoid sinus patency (Kf = 0.429); fair for discharge (Kf = 0.314), synechiae (Kf = 0.257), and middle meatus patency (Kf = 0.229); and poor for MT mucosal changes (Kf = 0.148) and uncinate process (Kf = 0.126). Conclusion: This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice.

AB - Background: Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, the objectivity and interrater agreement of the procedure related findings have not been well studied, especially in patients who have previously had sinus surgery. Methods: Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computed tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss' kappa statistic (Kf) and the prevalence- and bias-adjusted kappa (PABAK). Results: There were no significant correlations between age, Lund-Mackay score, or SNOT-22 score. Interrater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (Kf = 0.886); moderate for the assessments of middle turbinate (MT) integrity (Kf = 0.543), MT position (Kf = 0.443), maxillary sinus patency (Kf = 0.593), and ethmoid sinus patency (Kf = 0.429); fair for discharge (Kf = 0.314), synechiae (Kf = 0.257), and middle meatus patency (Kf = 0.229); and poor for MT mucosal changes (Kf = 0.148) and uncinate process (Kf = 0.126). Conclusion: This study was notable for variability in the interrater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice.

KW - Endoscopy

KW - Interobserver variability

KW - Paranasal sinuses

KW - Rhinosinusitis

KW - Surgery

UR - http://www.scopus.com/inward/record.url?scp=84870685080&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870685080&partnerID=8YFLogxK

U2 - 10.1002/alr.21058

DO - 10.1002/alr.21058

M3 - Article

C2 - 22696506

AN - SCOPUS:84870685080

VL - 2

SP - 453

EP - 459

JO - International Forum of Allergy and Rhinology

JF - International Forum of Allergy and Rhinology

SN - 2042-6976

IS - 6

ER -