Effect of an educational intervention on faculty and resident satisfaction with real-time feedback in the emergency department

Lalena Yarris, Rongwei (Rochelle) Fu, Joseph LaMantia, Judith A. Linden, H. Gene Hern, Cedric Lefebvre, David M. Nestler, Janis Tupesis, Nicholas Kman

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Objectives: Effective real-time feedback is critical to medical education. This study tested the hypothesis that an educational intervention related to feedback would improve emergency medicine (EM) faculty and resident physician satisfaction with feedback. Methods: This was a cluster-randomized, controlled study of 15 EM residency programs in 2007-2008. An educational intervention was created that combined a feedback curriculum with a card system designed to promote timely, effective feedback. Sites were randomized either to receive the intervention or to continue their current feedback method. All participants completed a Web-based survey before and after the intervention period. The primary outcome was overall feedback satisfaction on a 10-point scale. Additional items addressed specific aspects of feedback. Responses were compared using a generalized estimating equations model, adjusting for confounders and baseline differences between groups. The study was designed to achieve at least 80% power to detect a one-point difference in overall satisfaction (α = 0.05). Results: Response rates for pre- and postintervention surveys were 65.9 and 47.3% (faculty) and 64.7 and 56.9% (residents). Residents in the intervention group reported a mean overall increase in feedback satisfaction scores compared to those in the control group (mean increase 0.96 points, standard error [SE] ± 0.44, p = 0.03) and significantly higher satisfaction with the quality, amount, and timeliness of feedback. There were no significant differences in mean scores for overall and specific aspects of satisfaction between the faculty physician intervention and control groups. Conclusions: An intervention designed to improve real-time feedback in the ED resulted in higher resident satisfaction with feedback received, but did not affect faculty satisfaction with the feedback given.

Original languageEnglish (US)
Pages (from-to)504-512
Number of pages9
JournalAcademic Emergency Medicine
Volume18
Issue number5
DOIs
StatePublished - May 2011

Fingerprint

Hospital Emergency Service
Emergency Medicine
Physicians
Control Groups
Internship and Residency
Medical Education
Curriculum

ASJC Scopus subject areas

  • Emergency Medicine

Cite this

Effect of an educational intervention on faculty and resident satisfaction with real-time feedback in the emergency department. / Yarris, Lalena; Fu, Rongwei (Rochelle); LaMantia, Joseph; Linden, Judith A.; Gene Hern, H.; Lefebvre, Cedric; Nestler, David M.; Tupesis, Janis; Kman, Nicholas.

In: Academic Emergency Medicine, Vol. 18, No. 5, 05.2011, p. 504-512.

Research output: Contribution to journalArticle

Yarris, Lalena ; Fu, Rongwei (Rochelle) ; LaMantia, Joseph ; Linden, Judith A. ; Gene Hern, H. ; Lefebvre, Cedric ; Nestler, David M. ; Tupesis, Janis ; Kman, Nicholas. / Effect of an educational intervention on faculty and resident satisfaction with real-time feedback in the emergency department. In: Academic Emergency Medicine. 2011 ; Vol. 18, No. 5. pp. 504-512.
@article{7f9f92d46c254f288607fd7fe11b2f0d,
title = "Effect of an educational intervention on faculty and resident satisfaction with real-time feedback in the emergency department",
abstract = "Objectives: Effective real-time feedback is critical to medical education. This study tested the hypothesis that an educational intervention related to feedback would improve emergency medicine (EM) faculty and resident physician satisfaction with feedback. Methods: This was a cluster-randomized, controlled study of 15 EM residency programs in 2007-2008. An educational intervention was created that combined a feedback curriculum with a card system designed to promote timely, effective feedback. Sites were randomized either to receive the intervention or to continue their current feedback method. All participants completed a Web-based survey before and after the intervention period. The primary outcome was overall feedback satisfaction on a 10-point scale. Additional items addressed specific aspects of feedback. Responses were compared using a generalized estimating equations model, adjusting for confounders and baseline differences between groups. The study was designed to achieve at least 80{\%} power to detect a one-point difference in overall satisfaction (α = 0.05). Results: Response rates for pre- and postintervention surveys were 65.9 and 47.3{\%} (faculty) and 64.7 and 56.9{\%} (residents). Residents in the intervention group reported a mean overall increase in feedback satisfaction scores compared to those in the control group (mean increase 0.96 points, standard error [SE] ± 0.44, p = 0.03) and significantly higher satisfaction with the quality, amount, and timeliness of feedback. There were no significant differences in mean scores for overall and specific aspects of satisfaction between the faculty physician intervention and control groups. Conclusions: An intervention designed to improve real-time feedback in the ED resulted in higher resident satisfaction with feedback received, but did not affect faculty satisfaction with the feedback given.",
author = "Lalena Yarris and Fu, {Rongwei (Rochelle)} and Joseph LaMantia and Linden, {Judith A.} and {Gene Hern}, H. and Cedric Lefebvre and Nestler, {David M.} and Janis Tupesis and Nicholas Kman",
year = "2011",
month = "5",
doi = "10.1111/j.1553-2712.2011.01055.x",
language = "English (US)",
volume = "18",
pages = "504--512",
journal = "Academic Emergency Medicine",
issn = "1069-6563",
publisher = "Wiley-Blackwell",
number = "5",

}

TY - JOUR

T1 - Effect of an educational intervention on faculty and resident satisfaction with real-time feedback in the emergency department

AU - Yarris, Lalena

AU - Fu, Rongwei (Rochelle)

AU - LaMantia, Joseph

AU - Linden, Judith A.

AU - Gene Hern, H.

AU - Lefebvre, Cedric

AU - Nestler, David M.

AU - Tupesis, Janis

AU - Kman, Nicholas

PY - 2011/5

Y1 - 2011/5

N2 - Objectives: Effective real-time feedback is critical to medical education. This study tested the hypothesis that an educational intervention related to feedback would improve emergency medicine (EM) faculty and resident physician satisfaction with feedback. Methods: This was a cluster-randomized, controlled study of 15 EM residency programs in 2007-2008. An educational intervention was created that combined a feedback curriculum with a card system designed to promote timely, effective feedback. Sites were randomized either to receive the intervention or to continue their current feedback method. All participants completed a Web-based survey before and after the intervention period. The primary outcome was overall feedback satisfaction on a 10-point scale. Additional items addressed specific aspects of feedback. Responses were compared using a generalized estimating equations model, adjusting for confounders and baseline differences between groups. The study was designed to achieve at least 80% power to detect a one-point difference in overall satisfaction (α = 0.05). Results: Response rates for pre- and postintervention surveys were 65.9 and 47.3% (faculty) and 64.7 and 56.9% (residents). Residents in the intervention group reported a mean overall increase in feedback satisfaction scores compared to those in the control group (mean increase 0.96 points, standard error [SE] ± 0.44, p = 0.03) and significantly higher satisfaction with the quality, amount, and timeliness of feedback. There were no significant differences in mean scores for overall and specific aspects of satisfaction between the faculty physician intervention and control groups. Conclusions: An intervention designed to improve real-time feedback in the ED resulted in higher resident satisfaction with feedback received, but did not affect faculty satisfaction with the feedback given.

AB - Objectives: Effective real-time feedback is critical to medical education. This study tested the hypothesis that an educational intervention related to feedback would improve emergency medicine (EM) faculty and resident physician satisfaction with feedback. Methods: This was a cluster-randomized, controlled study of 15 EM residency programs in 2007-2008. An educational intervention was created that combined a feedback curriculum with a card system designed to promote timely, effective feedback. Sites were randomized either to receive the intervention or to continue their current feedback method. All participants completed a Web-based survey before and after the intervention period. The primary outcome was overall feedback satisfaction on a 10-point scale. Additional items addressed specific aspects of feedback. Responses were compared using a generalized estimating equations model, adjusting for confounders and baseline differences between groups. The study was designed to achieve at least 80% power to detect a one-point difference in overall satisfaction (α = 0.05). Results: Response rates for pre- and postintervention surveys were 65.9 and 47.3% (faculty) and 64.7 and 56.9% (residents). Residents in the intervention group reported a mean overall increase in feedback satisfaction scores compared to those in the control group (mean increase 0.96 points, standard error [SE] ± 0.44, p = 0.03) and significantly higher satisfaction with the quality, amount, and timeliness of feedback. There were no significant differences in mean scores for overall and specific aspects of satisfaction between the faculty physician intervention and control groups. Conclusions: An intervention designed to improve real-time feedback in the ED resulted in higher resident satisfaction with feedback received, but did not affect faculty satisfaction with the feedback given.

UR - http://www.scopus.com/inward/record.url?scp=79956157488&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79956157488&partnerID=8YFLogxK

U2 - 10.1111/j.1553-2712.2011.01055.x

DO - 10.1111/j.1553-2712.2011.01055.x

M3 - Article

C2 - 21569169

AN - SCOPUS:79956157488

VL - 18

SP - 504

EP - 512

JO - Academic Emergency Medicine

JF - Academic Emergency Medicine

SN - 1069-6563

IS - 5

ER -