Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism: A novel assessment instrument

Jennifer C. Kesselheim, Anu Agrawal, Nita Bhatia, Angel Cronin, Rima Jubran, Paul Kent, Leslie Kersun, Amulya Nageswara Rao, Melissa Rose, Stephanie Savelli, Mukta Sharma, Evan Shereck, Clare J. Twist, Michael Wang

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Background: Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. Procedure: We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). Results: For 90 participating fellows (74%), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31%) were identified as needing support. The self-assessment had a sensitivity of 50% (95% confidence interval [CI]: 31-69) and a specificity of 77% (95% CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. Conclusions: We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales.

Original languageEnglish (US)
JournalPediatric Blood and Cancer
DOIs
StateAccepted/In press - 2016

Fingerprint

Humanism
Hematology
Pediatrics
Confidence Intervals
Physicians
Equipment and Supplies
Focus Groups
Medicine
Depression
Professionalism
Self-Assessment

Keywords

  • Assessment
  • Fellowship
  • Humanism

ASJC Scopus subject areas

  • Pediatrics, Perinatology, and Child Health
  • Hematology
  • Oncology

Cite this

Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism : A novel assessment instrument. / Kesselheim, Jennifer C.; Agrawal, Anu; Bhatia, Nita; Cronin, Angel; Jubran, Rima; Kent, Paul; Kersun, Leslie; Rao, Amulya Nageswara; Rose, Melissa; Savelli, Stephanie; Sharma, Mukta; Shereck, Evan; Twist, Clare J.; Wang, Michael.

In: Pediatric Blood and Cancer, 2016.

Research output: Contribution to journalArticle

Kesselheim, JC, Agrawal, A, Bhatia, N, Cronin, A, Jubran, R, Kent, P, Kersun, L, Rao, AN, Rose, M, Savelli, S, Sharma, M, Shereck, E, Twist, CJ & Wang, M 2016, 'Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism: A novel assessment instrument', Pediatric Blood and Cancer. https://doi.org/10.1002/pbc.26316
Kesselheim, Jennifer C. ; Agrawal, Anu ; Bhatia, Nita ; Cronin, Angel ; Jubran, Rima ; Kent, Paul ; Kersun, Leslie ; Rao, Amulya Nageswara ; Rose, Melissa ; Savelli, Stephanie ; Sharma, Mukta ; Shereck, Evan ; Twist, Clare J. ; Wang, Michael. / Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism : A novel assessment instrument. In: Pediatric Blood and Cancer. 2016.
@article{59fc42572f2346d48dd331b618fcf8f1,
title = "Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism: A novel assessment instrument",
abstract = "Background: Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. Procedure: We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). Results: For 90 participating fellows (74{\%}), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31{\%}) were identified as needing support. The self-assessment had a sensitivity of 50{\%} (95{\%} confidence interval [CI]: 31-69) and a specificity of 77{\%} (95{\%} CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. Conclusions: We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales.",
keywords = "Assessment, Fellowship, Humanism",
author = "Kesselheim, {Jennifer C.} and Anu Agrawal and Nita Bhatia and Angel Cronin and Rima Jubran and Paul Kent and Leslie Kersun and Rao, {Amulya Nageswara} and Melissa Rose and Stephanie Savelli and Mukta Sharma and Evan Shereck and Twist, {Clare J.} and Michael Wang",
year = "2016",
doi = "10.1002/pbc.26316",
language = "English (US)",
journal = "Pediatric Blood and Cancer",
issn = "1545-5009",
publisher = "Wiley-Liss Inc.",

}

TY - JOUR

T1 - Measuring pediatric hematology-oncology fellows' skills in humanism and professionalism

T2 - A novel assessment instrument

AU - Kesselheim, Jennifer C.

AU - Agrawal, Anu

AU - Bhatia, Nita

AU - Cronin, Angel

AU - Jubran, Rima

AU - Kent, Paul

AU - Kersun, Leslie

AU - Rao, Amulya Nageswara

AU - Rose, Melissa

AU - Savelli, Stephanie

AU - Sharma, Mukta

AU - Shereck, Evan

AU - Twist, Clare J.

AU - Wang, Michael

PY - 2016

Y1 - 2016

N2 - Background: Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. Procedure: We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). Results: For 90 participating fellows (74%), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31%) were identified as needing support. The self-assessment had a sensitivity of 50% (95% confidence interval [CI]: 31-69) and a specificity of 77% (95% CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. Conclusions: We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales.

AB - Background: Educators in pediatric hematology-oncology lack rigorously developed instruments to assess fellows' skills in humanism and professionalism. Procedure: We developed a novel 15-item self-assessment instrument to address this gap in fellowship training. Fellows (N = 122) were asked to assess their skills in five domains: balancing competing demands of fellowship, caring for the dying patient, confronting depression and burnout, responding to challenging relationships with patients, and practicing humanistic medicine. An expert focus group predefined threshold scores on the instrument that could be used as a cutoff to identify fellows who need support. Reliability and feasibility were assessed and concurrent validity was measured using three established instruments: Maslach Burnout Inventory (MBI), Flourishing Scale (FS), and Jefferson Scale of Physician Empathy (JSPE). Results: For 90 participating fellows (74%), the self-assessment proved feasible to administer and had high internal consistency reliability (Cronbach's α = 0.81). It was moderately correlated with the FS and MBI (Pearson's r = 0.41 and 0.4, respectively) and weakly correlated with the JSPE (Pearson's r = 0.15). Twenty-eight fellows (31%) were identified as needing support. The self-assessment had a sensitivity of 50% (95% confidence interval [CI]: 31-69) and a specificity of 77% (95% CI: 65-87) for identifying fellows who scored poorly on at least one of the three established scales. Conclusions: We developed a novel assessment instrument for use in pediatric fellowship training. The new scale proved feasible and demonstrated internal consistency reliability. Its moderate correlation with other established instruments shows that the novel assessment instrument provides unique, nonredundant information as compared to existing scales.

KW - Assessment

KW - Fellowship

KW - Humanism

UR - http://www.scopus.com/inward/record.url?scp=84996520625&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84996520625&partnerID=8YFLogxK

U2 - 10.1002/pbc.26316

DO - 10.1002/pbc.26316

M3 - Article

C2 - 27808467

AN - SCOPUS:84996520625

JO - Pediatric Blood and Cancer

JF - Pediatric Blood and Cancer

SN - 1545-5009

ER -