A systematic review of assessment of skill acquisition and operative competency in vascular surgical training

Erica Mitchell, Sonal Arora, Gregory (Greg) Moneta, Marcus R. Kret, Phong T. Dargon, Gregory Landry, John F. Eidt, Nick Sevdalis

Research output: Contribution to journalArticle

30 Citations (Scopus)

Abstract

Objective The aim of this systematic review is to describe the literature and assessment tools evaluating vascular surgical operative performance that could potentially be used for the assessment of educational outcomes applicable to the Milestone Project and the Next Accreditation System. Methods A systematic review of PubMed/MEDLINE, EMBASE, PsycINFO, and key journals from 1985 to 2013 was performed to identify English-language articles describing assessment of vascular surgical skills and competence. Qualifying studies were abstracted for data concerning study aims, study and assessment setting, skills measured, and metrics used to determine competency. Strengths, weaknesses, and psychometric robustness of the assessment tools were determined. Results The literature search identified 617 citations. After title and abstract review, 65 articles were retrieved for full-text assessment and 48 articles were included in the final review. Twenty-nine articles assessed open vascular skills; 19, endovascular skills; six, nontechnical skills; and one, teamwork skills. The majority (84%) of studies were performed in a simulated environment, four (8%) were performed in the operating room, and the remaining three were performed in both a simulated environment and an operating room. Strengths and weaknesses of assessment tools were study and assessor dependent, with none applicable to all study scenarios or procedures. Conclusions The literature describing assessment tools pertinent to vascular surgery is diverse. Existing assessment tools may be relevant to individual technical skill acquisition assessment; however, an operative assessment tool relevant to vascular/endovascular surgery and generalizable to the wide spectrum of technical and nontechnical skills pertinent to vascular surgery needs to be developed, validated, and implemented to allow the practical assessment of resident readiness to operate in an unsupervised setting.

Original languageEnglish (US)
Pages (from-to)1440-1455
Number of pages16
JournalJournal of Vascular Surgery
Volume59
Issue number5
DOIs
StatePublished - 2014

Fingerprint

Blood Vessels
Operating Rooms
Educational Measurement
Accreditation
Psychometrics
PubMed
MEDLINE
Mental Competency
Language
Outcome Assessment (Health Care)

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Surgery

Cite this

A systematic review of assessment of skill acquisition and operative competency in vascular surgical training. / Mitchell, Erica; Arora, Sonal; Moneta, Gregory (Greg); Kret, Marcus R.; Dargon, Phong T.; Landry, Gregory; Eidt, John F.; Sevdalis, Nick.

In: Journal of Vascular Surgery, Vol. 59, No. 5, 2014, p. 1440-1455.

Research output: Contribution to journalArticle

Mitchell, Erica ; Arora, Sonal ; Moneta, Gregory (Greg) ; Kret, Marcus R. ; Dargon, Phong T. ; Landry, Gregory ; Eidt, John F. ; Sevdalis, Nick. / A systematic review of assessment of skill acquisition and operative competency in vascular surgical training. In: Journal of Vascular Surgery. 2014 ; Vol. 59, No. 5. pp. 1440-1455.
@article{7215f7a2b88442919a7e222cccc130bd,
title = "A systematic review of assessment of skill acquisition and operative competency in vascular surgical training",
abstract = "Objective The aim of this systematic review is to describe the literature and assessment tools evaluating vascular surgical operative performance that could potentially be used for the assessment of educational outcomes applicable to the Milestone Project and the Next Accreditation System. Methods A systematic review of PubMed/MEDLINE, EMBASE, PsycINFO, and key journals from 1985 to 2013 was performed to identify English-language articles describing assessment of vascular surgical skills and competence. Qualifying studies were abstracted for data concerning study aims, study and assessment setting, skills measured, and metrics used to determine competency. Strengths, weaknesses, and psychometric robustness of the assessment tools were determined. Results The literature search identified 617 citations. After title and abstract review, 65 articles were retrieved for full-text assessment and 48 articles were included in the final review. Twenty-nine articles assessed open vascular skills; 19, endovascular skills; six, nontechnical skills; and one, teamwork skills. The majority (84{\%}) of studies were performed in a simulated environment, four (8{\%}) were performed in the operating room, and the remaining three were performed in both a simulated environment and an operating room. Strengths and weaknesses of assessment tools were study and assessor dependent, with none applicable to all study scenarios or procedures. Conclusions The literature describing assessment tools pertinent to vascular surgery is diverse. Existing assessment tools may be relevant to individual technical skill acquisition assessment; however, an operative assessment tool relevant to vascular/endovascular surgery and generalizable to the wide spectrum of technical and nontechnical skills pertinent to vascular surgery needs to be developed, validated, and implemented to allow the practical assessment of resident readiness to operate in an unsupervised setting.",
author = "Erica Mitchell and Sonal Arora and Moneta, {Gregory (Greg)} and Kret, {Marcus R.} and Dargon, {Phong T.} and Gregory Landry and Eidt, {John F.} and Nick Sevdalis",
year = "2014",
doi = "10.1016/j.jvs.2014.02.018",
language = "English (US)",
volume = "59",
pages = "1440--1455",
journal = "Journal of Vascular Surgery",
issn = "0741-5214",
publisher = "Mosby Inc.",
number = "5",

}

TY - JOUR

T1 - A systematic review of assessment of skill acquisition and operative competency in vascular surgical training

AU - Mitchell, Erica

AU - Arora, Sonal

AU - Moneta, Gregory (Greg)

AU - Kret, Marcus R.

AU - Dargon, Phong T.

AU - Landry, Gregory

AU - Eidt, John F.

AU - Sevdalis, Nick

PY - 2014

Y1 - 2014

N2 - Objective The aim of this systematic review is to describe the literature and assessment tools evaluating vascular surgical operative performance that could potentially be used for the assessment of educational outcomes applicable to the Milestone Project and the Next Accreditation System. Methods A systematic review of PubMed/MEDLINE, EMBASE, PsycINFO, and key journals from 1985 to 2013 was performed to identify English-language articles describing assessment of vascular surgical skills and competence. Qualifying studies were abstracted for data concerning study aims, study and assessment setting, skills measured, and metrics used to determine competency. Strengths, weaknesses, and psychometric robustness of the assessment tools were determined. Results The literature search identified 617 citations. After title and abstract review, 65 articles were retrieved for full-text assessment and 48 articles were included in the final review. Twenty-nine articles assessed open vascular skills; 19, endovascular skills; six, nontechnical skills; and one, teamwork skills. The majority (84%) of studies were performed in a simulated environment, four (8%) were performed in the operating room, and the remaining three were performed in both a simulated environment and an operating room. Strengths and weaknesses of assessment tools were study and assessor dependent, with none applicable to all study scenarios or procedures. Conclusions The literature describing assessment tools pertinent to vascular surgery is diverse. Existing assessment tools may be relevant to individual technical skill acquisition assessment; however, an operative assessment tool relevant to vascular/endovascular surgery and generalizable to the wide spectrum of technical and nontechnical skills pertinent to vascular surgery needs to be developed, validated, and implemented to allow the practical assessment of resident readiness to operate in an unsupervised setting.

AB - Objective The aim of this systematic review is to describe the literature and assessment tools evaluating vascular surgical operative performance that could potentially be used for the assessment of educational outcomes applicable to the Milestone Project and the Next Accreditation System. Methods A systematic review of PubMed/MEDLINE, EMBASE, PsycINFO, and key journals from 1985 to 2013 was performed to identify English-language articles describing assessment of vascular surgical skills and competence. Qualifying studies were abstracted for data concerning study aims, study and assessment setting, skills measured, and metrics used to determine competency. Strengths, weaknesses, and psychometric robustness of the assessment tools were determined. Results The literature search identified 617 citations. After title and abstract review, 65 articles were retrieved for full-text assessment and 48 articles were included in the final review. Twenty-nine articles assessed open vascular skills; 19, endovascular skills; six, nontechnical skills; and one, teamwork skills. The majority (84%) of studies were performed in a simulated environment, four (8%) were performed in the operating room, and the remaining three were performed in both a simulated environment and an operating room. Strengths and weaknesses of assessment tools were study and assessor dependent, with none applicable to all study scenarios or procedures. Conclusions The literature describing assessment tools pertinent to vascular surgery is diverse. Existing assessment tools may be relevant to individual technical skill acquisition assessment; however, an operative assessment tool relevant to vascular/endovascular surgery and generalizable to the wide spectrum of technical and nontechnical skills pertinent to vascular surgery needs to be developed, validated, and implemented to allow the practical assessment of resident readiness to operate in an unsupervised setting.

UR - http://www.scopus.com/inward/record.url?scp=84899576255&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84899576255&partnerID=8YFLogxK

U2 - 10.1016/j.jvs.2014.02.018

DO - 10.1016/j.jvs.2014.02.018

M3 - Article

C2 - 24655750

AN - SCOPUS:84899576255

VL - 59

SP - 1440

EP - 1455

JO - Journal of Vascular Surgery

JF - Journal of Vascular Surgery

SN - 0741-5214

IS - 5

ER -