Discrepancy rates of on-call radiology residents' interpretations of CT angiography studies of the neck and circle of Willis

Russell E. Meyer, Joshua Nickerson, Heather N. Burbank, Gary F. Alsofrom, Grant J. Linnell, Christopher G. Filippi

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

OBJECTIVE. The purpose of our study was to determine the discrepancy rates of radiology residents' interpretations of emergent CT angiography (CTA) studies of the neck and circle of Willis and to assess any adverse clinical outcomes. MATERIALS AND METHODS. Five hundred thirty-eight CTA studies (287 circle of Willis and 251 neck) ordered emergently after hours and given preliminary readings by radiology residents from January 1, 2006, through December 31, 2007, were retrospectively reviewed. Discrepancies between the interpretations of radiology residents and the final reports of neuroradiology attending physicians were classified as either false-negatives (failure to recognize abnormalities) or false-positives (misinterpreting normal scans as abnormal). Discrepancies that could affect patient care or clinical care were considered major. RESULTS. Overall, the discrepancy rate was 13.6% for circle of Willis CTA and 13.5% for neck CTA. The misinterpretation rate of first-year residents was 19.5%, which was statistically significant compared with more senior-level residents (p = 0.05). There were 57 false-negative interpretations. The most common misses were stenosis greater than 50% (n = 16) and aneurysm (n = 15), and the most common false-positive was overcalling a potential intracranial aneurysm (n = 7). No adverse clinical outcomes were detected. CONCLUSION. The discrepancy rate between interpretations by on-call radiology residents and attending physicians of neuroradiology CTA studies was higher than expected at 13.6%, with a statistically significant greater miss rate among the most junior residents, which may be mitigated by recent changes with respect to the radiology residents' overnight call. No adverse clinical outcome was detected.

Original languageEnglish (US)
Pages (from-to)527-532
Number of pages6
JournalAmerican Journal of Roentgenology
Volume193
Issue number2
DOIs
StatePublished - Aug 1 2009
Externally publishedYes

Fingerprint

Circle of Willis
Radiology
Neck
Physicians
Intracranial Aneurysm
Aneurysm
Reading
Patient Care
Pathologic Constriction
Computed Tomography Angiography

Keywords

  • Circle of Willis
  • CT angiography
  • Neck
  • Practice-based learning
  • Radiology residency call
  • Systems-based practices

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Discrepancy rates of on-call radiology residents' interpretations of CT angiography studies of the neck and circle of Willis. / Meyer, Russell E.; Nickerson, Joshua; Burbank, Heather N.; Alsofrom, Gary F.; Linnell, Grant J.; Filippi, Christopher G.

In: American Journal of Roentgenology, Vol. 193, No. 2, 01.08.2009, p. 527-532.

Research output: Contribution to journalArticle

Meyer, Russell E. ; Nickerson, Joshua ; Burbank, Heather N. ; Alsofrom, Gary F. ; Linnell, Grant J. ; Filippi, Christopher G. / Discrepancy rates of on-call radiology residents' interpretations of CT angiography studies of the neck and circle of Willis. In: American Journal of Roentgenology. 2009 ; Vol. 193, No. 2. pp. 527-532.
@article{3b9c30d8f7bb4809b90200f0ef957235,
title = "Discrepancy rates of on-call radiology residents' interpretations of CT angiography studies of the neck and circle of Willis",
abstract = "OBJECTIVE. The purpose of our study was to determine the discrepancy rates of radiology residents' interpretations of emergent CT angiography (CTA) studies of the neck and circle of Willis and to assess any adverse clinical outcomes. MATERIALS AND METHODS. Five hundred thirty-eight CTA studies (287 circle of Willis and 251 neck) ordered emergently after hours and given preliminary readings by radiology residents from January 1, 2006, through December 31, 2007, were retrospectively reviewed. Discrepancies between the interpretations of radiology residents and the final reports of neuroradiology attending physicians were classified as either false-negatives (failure to recognize abnormalities) or false-positives (misinterpreting normal scans as abnormal). Discrepancies that could affect patient care or clinical care were considered major. RESULTS. Overall, the discrepancy rate was 13.6{\%} for circle of Willis CTA and 13.5{\%} for neck CTA. The misinterpretation rate of first-year residents was 19.5{\%}, which was statistically significant compared with more senior-level residents (p = 0.05). There were 57 false-negative interpretations. The most common misses were stenosis greater than 50{\%} (n = 16) and aneurysm (n = 15), and the most common false-positive was overcalling a potential intracranial aneurysm (n = 7). No adverse clinical outcomes were detected. CONCLUSION. The discrepancy rate between interpretations by on-call radiology residents and attending physicians of neuroradiology CTA studies was higher than expected at 13.6{\%}, with a statistically significant greater miss rate among the most junior residents, which may be mitigated by recent changes with respect to the radiology residents' overnight call. No adverse clinical outcome was detected.",
keywords = "Circle of Willis, CT angiography, Neck, Practice-based learning, Radiology residency call, Systems-based practices",
author = "Meyer, {Russell E.} and Joshua Nickerson and Burbank, {Heather N.} and Alsofrom, {Gary F.} and Linnell, {Grant J.} and Filippi, {Christopher G.}",
year = "2009",
month = "8",
day = "1",
doi = "10.2214/AJR.08.2169",
language = "English (US)",
volume = "193",
pages = "527--532",
journal = "AJR. American journal of roentgenology",
issn = "0361-803X",
publisher = "American Roentgen Ray Society",
number = "2",

}

TY - JOUR

T1 - Discrepancy rates of on-call radiology residents' interpretations of CT angiography studies of the neck and circle of Willis

AU - Meyer, Russell E.

AU - Nickerson, Joshua

AU - Burbank, Heather N.

AU - Alsofrom, Gary F.

AU - Linnell, Grant J.

AU - Filippi, Christopher G.

PY - 2009/8/1

Y1 - 2009/8/1

N2 - OBJECTIVE. The purpose of our study was to determine the discrepancy rates of radiology residents' interpretations of emergent CT angiography (CTA) studies of the neck and circle of Willis and to assess any adverse clinical outcomes. MATERIALS AND METHODS. Five hundred thirty-eight CTA studies (287 circle of Willis and 251 neck) ordered emergently after hours and given preliminary readings by radiology residents from January 1, 2006, through December 31, 2007, were retrospectively reviewed. Discrepancies between the interpretations of radiology residents and the final reports of neuroradiology attending physicians were classified as either false-negatives (failure to recognize abnormalities) or false-positives (misinterpreting normal scans as abnormal). Discrepancies that could affect patient care or clinical care were considered major. RESULTS. Overall, the discrepancy rate was 13.6% for circle of Willis CTA and 13.5% for neck CTA. The misinterpretation rate of first-year residents was 19.5%, which was statistically significant compared with more senior-level residents (p = 0.05). There were 57 false-negative interpretations. The most common misses were stenosis greater than 50% (n = 16) and aneurysm (n = 15), and the most common false-positive was overcalling a potential intracranial aneurysm (n = 7). No adverse clinical outcomes were detected. CONCLUSION. The discrepancy rate between interpretations by on-call radiology residents and attending physicians of neuroradiology CTA studies was higher than expected at 13.6%, with a statistically significant greater miss rate among the most junior residents, which may be mitigated by recent changes with respect to the radiology residents' overnight call. No adverse clinical outcome was detected.

AB - OBJECTIVE. The purpose of our study was to determine the discrepancy rates of radiology residents' interpretations of emergent CT angiography (CTA) studies of the neck and circle of Willis and to assess any adverse clinical outcomes. MATERIALS AND METHODS. Five hundred thirty-eight CTA studies (287 circle of Willis and 251 neck) ordered emergently after hours and given preliminary readings by radiology residents from January 1, 2006, through December 31, 2007, were retrospectively reviewed. Discrepancies between the interpretations of radiology residents and the final reports of neuroradiology attending physicians were classified as either false-negatives (failure to recognize abnormalities) or false-positives (misinterpreting normal scans as abnormal). Discrepancies that could affect patient care or clinical care were considered major. RESULTS. Overall, the discrepancy rate was 13.6% for circle of Willis CTA and 13.5% for neck CTA. The misinterpretation rate of first-year residents was 19.5%, which was statistically significant compared with more senior-level residents (p = 0.05). There were 57 false-negative interpretations. The most common misses were stenosis greater than 50% (n = 16) and aneurysm (n = 15), and the most common false-positive was overcalling a potential intracranial aneurysm (n = 7). No adverse clinical outcomes were detected. CONCLUSION. The discrepancy rate between interpretations by on-call radiology residents and attending physicians of neuroradiology CTA studies was higher than expected at 13.6%, with a statistically significant greater miss rate among the most junior residents, which may be mitigated by recent changes with respect to the radiology residents' overnight call. No adverse clinical outcome was detected.

KW - Circle of Willis

KW - CT angiography

KW - Neck

KW - Practice-based learning

KW - Radiology residency call

KW - Systems-based practices

UR - http://www.scopus.com/inward/record.url?scp=68149157034&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=68149157034&partnerID=8YFLogxK

U2 - 10.2214/AJR.08.2169

DO - 10.2214/AJR.08.2169

M3 - Article

C2 - 19620452

AN - SCOPUS:68149157034

VL - 193

SP - 527

EP - 532

JO - AJR. American journal of roentgenology

JF - AJR. American journal of roentgenology

SN - 0361-803X

IS - 2

ER -