Reflections in a time of transition: Orthopaedic faculty and resident understanding of accreditation schemes and opinions on surgical skills feedback

Kenneth Gundle, Dayne T. Mickelson, Doug P. Hanel

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Introduction: Orthopaedic surgery is one of the first seven specialties that began collecting Milestone data as part of the Accreditation Council for Graduate Medical Education's Next Accreditation System (NAS) rollout. This transition from process-based advancement to outcome-based education is an opportunity to assess resident and faculty understanding of changing paradigms, and opinions about technical skill evaluation. Methods: In a large academic orthopaedic surgery residency program, residents and facultywere anonymously surveyed. A total of 31/32 (97%) residents and 29/53 (55%) faculty responded to Likert scale assessments and provided open-ended responses.Aninternal end-of-rotation auditwas conducted to assess timeliness of evaluations.Amixedmethod analysiswas utilized,with nonparametric statistical testing and a constant-comparative qualitativemethod. Results: There was greater familiarity with the six core competencies than with Milestones or the NAS (p<0.05). A majority of faculty and residents felt that end-of-rotation evaluations were not adequate for surgical skills feedback. Fifty-eight per cent of residents reported that end-of-rotation evaluations were rarely or never filled out in a timely fashion. An internal audit demonstrated that more than 30% of evaluations were completed over a month after rotation end. Qualitative analysis included themes of resident desire for more faceto- face feedback on technical skills after operative cases, and several barriers to more frequent feedback. Discussion: TheNAS and outcome-based education have arrived. Residents and faculty need to be educated on this changing paradigm. This transition period is also awindowof opportunity to address methods of evaluation and feedback. In our orthopaedic residency, trainees were significantly less satisfied than faculty with the amount of technical and surgical skills feedback being provided to trainees. The quantitative and qualitative analyses converge on one theme: a desire for frequent, explicit, timely feedback after operative cases. To overcome the time-limited clinical environment, feedback tools need to be easily integrated and efficient. Creative solutions may be needed to truly achieve outcome-based graduate medical education.

Original languageEnglish (US)
Article number30584
JournalMedical Education Online
Volume21
Issue number1
DOIs
StatePublished - Jan 1 2016
Externally publishedYes

Fingerprint

accreditation
resident
evaluation
trainee
surgery
education
graduate
paradigm
time
audit

Keywords

  • Competency
  • Feedback
  • Next Accreditation System
  • Qualitative analysis
  • Technical skills

ASJC Scopus subject areas

  • Education

Cite this

Reflections in a time of transition : Orthopaedic faculty and resident understanding of accreditation schemes and opinions on surgical skills feedback. / Gundle, Kenneth; Mickelson, Dayne T.; Hanel, Doug P.

In: Medical Education Online, Vol. 21, No. 1, 30584, 01.01.2016.

Research output: Contribution to journalArticle

@article{9a1369b844e04a469f22bc4e37ccc651,
title = "Reflections in a time of transition: Orthopaedic faculty and resident understanding of accreditation schemes and opinions on surgical skills feedback",
abstract = "Introduction: Orthopaedic surgery is one of the first seven specialties that began collecting Milestone data as part of the Accreditation Council for Graduate Medical Education's Next Accreditation System (NAS) rollout. This transition from process-based advancement to outcome-based education is an opportunity to assess resident and faculty understanding of changing paradigms, and opinions about technical skill evaluation. Methods: In a large academic orthopaedic surgery residency program, residents and facultywere anonymously surveyed. A total of 31/32 (97{\%}) residents and 29/53 (55{\%}) faculty responded to Likert scale assessments and provided open-ended responses.Aninternal end-of-rotation auditwas conducted to assess timeliness of evaluations.Amixedmethod analysiswas utilized,with nonparametric statistical testing and a constant-comparative qualitativemethod. Results: There was greater familiarity with the six core competencies than with Milestones or the NAS (p<0.05). A majority of faculty and residents felt that end-of-rotation evaluations were not adequate for surgical skills feedback. Fifty-eight per cent of residents reported that end-of-rotation evaluations were rarely or never filled out in a timely fashion. An internal audit demonstrated that more than 30{\%} of evaluations were completed over a month after rotation end. Qualitative analysis included themes of resident desire for more faceto- face feedback on technical skills after operative cases, and several barriers to more frequent feedback. Discussion: TheNAS and outcome-based education have arrived. Residents and faculty need to be educated on this changing paradigm. This transition period is also awindowof opportunity to address methods of evaluation and feedback. In our orthopaedic residency, trainees were significantly less satisfied than faculty with the amount of technical and surgical skills feedback being provided to trainees. The quantitative and qualitative analyses converge on one theme: a desire for frequent, explicit, timely feedback after operative cases. To overcome the time-limited clinical environment, feedback tools need to be easily integrated and efficient. Creative solutions may be needed to truly achieve outcome-based graduate medical education.",
keywords = "Competency, Feedback, Next Accreditation System, Qualitative analysis, Technical skills",
author = "Kenneth Gundle and Mickelson, {Dayne T.} and Hanel, {Doug P.}",
year = "2016",
month = "1",
day = "1",
doi = "10.3402/meo.v21.30584",
language = "English (US)",
volume = "21",
journal = "Medical Education Online",
issn = "1087-2981",
publisher = "Co-Action Publishing",
number = "1",

}

TY - JOUR

T1 - Reflections in a time of transition

T2 - Orthopaedic faculty and resident understanding of accreditation schemes and opinions on surgical skills feedback

AU - Gundle, Kenneth

AU - Mickelson, Dayne T.

AU - Hanel, Doug P.

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Introduction: Orthopaedic surgery is one of the first seven specialties that began collecting Milestone data as part of the Accreditation Council for Graduate Medical Education's Next Accreditation System (NAS) rollout. This transition from process-based advancement to outcome-based education is an opportunity to assess resident and faculty understanding of changing paradigms, and opinions about technical skill evaluation. Methods: In a large academic orthopaedic surgery residency program, residents and facultywere anonymously surveyed. A total of 31/32 (97%) residents and 29/53 (55%) faculty responded to Likert scale assessments and provided open-ended responses.Aninternal end-of-rotation auditwas conducted to assess timeliness of evaluations.Amixedmethod analysiswas utilized,with nonparametric statistical testing and a constant-comparative qualitativemethod. Results: There was greater familiarity with the six core competencies than with Milestones or the NAS (p<0.05). A majority of faculty and residents felt that end-of-rotation evaluations were not adequate for surgical skills feedback. Fifty-eight per cent of residents reported that end-of-rotation evaluations were rarely or never filled out in a timely fashion. An internal audit demonstrated that more than 30% of evaluations were completed over a month after rotation end. Qualitative analysis included themes of resident desire for more faceto- face feedback on technical skills after operative cases, and several barriers to more frequent feedback. Discussion: TheNAS and outcome-based education have arrived. Residents and faculty need to be educated on this changing paradigm. This transition period is also awindowof opportunity to address methods of evaluation and feedback. In our orthopaedic residency, trainees were significantly less satisfied than faculty with the amount of technical and surgical skills feedback being provided to trainees. The quantitative and qualitative analyses converge on one theme: a desire for frequent, explicit, timely feedback after operative cases. To overcome the time-limited clinical environment, feedback tools need to be easily integrated and efficient. Creative solutions may be needed to truly achieve outcome-based graduate medical education.

AB - Introduction: Orthopaedic surgery is one of the first seven specialties that began collecting Milestone data as part of the Accreditation Council for Graduate Medical Education's Next Accreditation System (NAS) rollout. This transition from process-based advancement to outcome-based education is an opportunity to assess resident and faculty understanding of changing paradigms, and opinions about technical skill evaluation. Methods: In a large academic orthopaedic surgery residency program, residents and facultywere anonymously surveyed. A total of 31/32 (97%) residents and 29/53 (55%) faculty responded to Likert scale assessments and provided open-ended responses.Aninternal end-of-rotation auditwas conducted to assess timeliness of evaluations.Amixedmethod analysiswas utilized,with nonparametric statistical testing and a constant-comparative qualitativemethod. Results: There was greater familiarity with the six core competencies than with Milestones or the NAS (p<0.05). A majority of faculty and residents felt that end-of-rotation evaluations were not adequate for surgical skills feedback. Fifty-eight per cent of residents reported that end-of-rotation evaluations were rarely or never filled out in a timely fashion. An internal audit demonstrated that more than 30% of evaluations were completed over a month after rotation end. Qualitative analysis included themes of resident desire for more faceto- face feedback on technical skills after operative cases, and several barriers to more frequent feedback. Discussion: TheNAS and outcome-based education have arrived. Residents and faculty need to be educated on this changing paradigm. This transition period is also awindowof opportunity to address methods of evaluation and feedback. In our orthopaedic residency, trainees were significantly less satisfied than faculty with the amount of technical and surgical skills feedback being provided to trainees. The quantitative and qualitative analyses converge on one theme: a desire for frequent, explicit, timely feedback after operative cases. To overcome the time-limited clinical environment, feedback tools need to be easily integrated and efficient. Creative solutions may be needed to truly achieve outcome-based graduate medical education.

KW - Competency

KW - Feedback

KW - Next Accreditation System

KW - Qualitative analysis

KW - Technical skills

UR - http://www.scopus.com/inward/record.url?scp=85007143675&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85007143675&partnerID=8YFLogxK

U2 - 10.3402/meo.v21.30584

DO - 10.3402/meo.v21.30584

M3 - Article

C2 - 27079887

AN - SCOPUS:85007143675

VL - 21

JO - Medical Education Online

JF - Medical Education Online

SN - 1087-2981

IS - 1

M1 - 30584

ER -