Development of an objective structured assessment of technical skills for obstetric and gynecology residents

Barbara A. Goff, Gretchen M. Lentz, David Lee, Brenda Houmard, Lynn S. Mandel

Research output: Contribution to journalArticle

106 Citations (Scopus)

Abstract

Objective: To develop an objective structured assessment for evaluating surgical skills of obstetrics and gynecology residents and to evaluate the reliability and validity of the assessment. Methods: A seven-station, objective, structured assessment of technical skills was administered to 24 residents. The test included laparoscopic procedures (port placement, salpingostomy, suturing, vessel ligation) and open abdominal procedures (hypogastric ligation, repair of enterotomy, salpingo-oophorectomy.) All surgical tasks were done on pigs. Residents were timed and assessed at each station using three methods of scoring, a task-specific checklist, global rating scale, and pass-fail grade. Results: Assessment of construct validity (the ability of the test to discriminate among residency levels) found significant differences on the checklist and the global rating scale by residency level. Reliability indices calculated with Cronbach's α were 0.89 for the global rating scale and 0.89-0.95 for the individual skills checklists. Interrater reliability was 0.87 for the global rating scale and 0.78-0.98 for the checklists. Conclusion: Objective, structured assessment of technical skills can assess residents' surgical skills with high reliability and validity. These assessments have possible application for identifying residents who need additional training and might provide a mechanism to ensure competence of surgical skills. Copyright (C) 2000 The American College of Obstetricians and Gynecologists.

Original languageEnglish (US)
Pages (from-to)146-150
Number of pages5
JournalObstetrics and Gynecology
Volume96
Issue number1
DOIs
StatePublished - Jul 2000
Externally publishedYes

Fingerprint

Checklist
Gynecology
Obstetrics
Internship and Residency
Reproducibility of Results
Ligation
Salpingostomy
Aptitude
Ovariectomy
Mental Competency
Research Design
Swine

ASJC Scopus subject areas

  • Obstetrics and Gynecology

Cite this

Development of an objective structured assessment of technical skills for obstetric and gynecology residents. / Goff, Barbara A.; Lentz, Gretchen M.; Lee, David; Houmard, Brenda; Mandel, Lynn S.

In: Obstetrics and Gynecology, Vol. 96, No. 1, 07.2000, p. 146-150.

Research output: Contribution to journalArticle

Goff, Barbara A. ; Lentz, Gretchen M. ; Lee, David ; Houmard, Brenda ; Mandel, Lynn S. / Development of an objective structured assessment of technical skills for obstetric and gynecology residents. In: Obstetrics and Gynecology. 2000 ; Vol. 96, No. 1. pp. 146-150.
@article{b83a231972a34f73a8f6a11938d4df59,
title = "Development of an objective structured assessment of technical skills for obstetric and gynecology residents",
abstract = "Objective: To develop an objective structured assessment for evaluating surgical skills of obstetrics and gynecology residents and to evaluate the reliability and validity of the assessment. Methods: A seven-station, objective, structured assessment of technical skills was administered to 24 residents. The test included laparoscopic procedures (port placement, salpingostomy, suturing, vessel ligation) and open abdominal procedures (hypogastric ligation, repair of enterotomy, salpingo-oophorectomy.) All surgical tasks were done on pigs. Residents were timed and assessed at each station using three methods of scoring, a task-specific checklist, global rating scale, and pass-fail grade. Results: Assessment of construct validity (the ability of the test to discriminate among residency levels) found significant differences on the checklist and the global rating scale by residency level. Reliability indices calculated with Cronbach's α were 0.89 for the global rating scale and 0.89-0.95 for the individual skills checklists. Interrater reliability was 0.87 for the global rating scale and 0.78-0.98 for the checklists. Conclusion: Objective, structured assessment of technical skills can assess residents' surgical skills with high reliability and validity. These assessments have possible application for identifying residents who need additional training and might provide a mechanism to ensure competence of surgical skills. Copyright (C) 2000 The American College of Obstetricians and Gynecologists.",
author = "Goff, {Barbara A.} and Lentz, {Gretchen M.} and David Lee and Brenda Houmard and Mandel, {Lynn S.}",
year = "2000",
month = "7",
doi = "10.1016/S0029-7844(00)00829-2",
language = "English (US)",
volume = "96",
pages = "146--150",
journal = "Obstetrics and Gynecology",
issn = "0029-7844",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - Development of an objective structured assessment of technical skills for obstetric and gynecology residents

AU - Goff, Barbara A.

AU - Lentz, Gretchen M.

AU - Lee, David

AU - Houmard, Brenda

AU - Mandel, Lynn S.

PY - 2000/7

Y1 - 2000/7

N2 - Objective: To develop an objective structured assessment for evaluating surgical skills of obstetrics and gynecology residents and to evaluate the reliability and validity of the assessment. Methods: A seven-station, objective, structured assessment of technical skills was administered to 24 residents. The test included laparoscopic procedures (port placement, salpingostomy, suturing, vessel ligation) and open abdominal procedures (hypogastric ligation, repair of enterotomy, salpingo-oophorectomy.) All surgical tasks were done on pigs. Residents were timed and assessed at each station using three methods of scoring, a task-specific checklist, global rating scale, and pass-fail grade. Results: Assessment of construct validity (the ability of the test to discriminate among residency levels) found significant differences on the checklist and the global rating scale by residency level. Reliability indices calculated with Cronbach's α were 0.89 for the global rating scale and 0.89-0.95 for the individual skills checklists. Interrater reliability was 0.87 for the global rating scale and 0.78-0.98 for the checklists. Conclusion: Objective, structured assessment of technical skills can assess residents' surgical skills with high reliability and validity. These assessments have possible application for identifying residents who need additional training and might provide a mechanism to ensure competence of surgical skills. Copyright (C) 2000 The American College of Obstetricians and Gynecologists.

AB - Objective: To develop an objective structured assessment for evaluating surgical skills of obstetrics and gynecology residents and to evaluate the reliability and validity of the assessment. Methods: A seven-station, objective, structured assessment of technical skills was administered to 24 residents. The test included laparoscopic procedures (port placement, salpingostomy, suturing, vessel ligation) and open abdominal procedures (hypogastric ligation, repair of enterotomy, salpingo-oophorectomy.) All surgical tasks were done on pigs. Residents were timed and assessed at each station using three methods of scoring, a task-specific checklist, global rating scale, and pass-fail grade. Results: Assessment of construct validity (the ability of the test to discriminate among residency levels) found significant differences on the checklist and the global rating scale by residency level. Reliability indices calculated with Cronbach's α were 0.89 for the global rating scale and 0.89-0.95 for the individual skills checklists. Interrater reliability was 0.87 for the global rating scale and 0.78-0.98 for the checklists. Conclusion: Objective, structured assessment of technical skills can assess residents' surgical skills with high reliability and validity. These assessments have possible application for identifying residents who need additional training and might provide a mechanism to ensure competence of surgical skills. Copyright (C) 2000 The American College of Obstetricians and Gynecologists.

UR - http://www.scopus.com/inward/record.url?scp=0034076451&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0034076451&partnerID=8YFLogxK

U2 - 10.1016/S0029-7844(00)00829-2

DO - 10.1016/S0029-7844(00)00829-2

M3 - Article

VL - 96

SP - 146

EP - 150

JO - Obstetrics and Gynecology

JF - Obstetrics and Gynecology

SN - 0029-7844

IS - 1

ER -