Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: A report from the EXPRESS pediatric research collaborative

Jonathan P. Duff, Adam Cheng, Louise M. Bahry, Jeff Hopkins, Matthew Richard, Steven M. Schexnayder, Mike Carbonaro, Elizabeth A. Hunt, Vinay M. Nadkarni, Kristen Nelson-McMillan, Aaron Donoghue, Akira Nishisaki, Judy LeFlore, Walter Eppich, Mark Adler, Mike Moyer, Marisa Brett-Fleegler, Monica Kleinman, JoDee Anderson, Matthew BragaSusanne Kost, Glenn Stryjewski, Steve Min, John Podraza, Joseph Lopreiato, Melinda Fiedor Hamilton, Kimberly Stone, Jennifer Reid, Jennifer Manos, Liana Kappus, Douglas Leonard, Kathleen Ventre, Kristine Boyle, Laura Corbin, Marino Festa, Frank Overly, Stephanie Sudikoff, Takanari Ikeyama, Jenny Rudolph, Robert Simon, John R. Boulet, Louis P. Halamek, John Gosbee, Laura Gosbee

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Introduction: Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study). Methods: Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives. Results: 435 health care professionals completed the MCQ examination with an average score of 69.3%. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed. Conclusion: This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.

Original languageEnglish (US)
Pages (from-to)365-368
Number of pages4
JournalResuscitation
Volume84
Issue number3
DOIs
StatePublished - Mar 2013

Fingerprint

Resuscitation
Pediatrics
Research
Learning
Reproducibility of Results
Statistical Factor Analysis
Hospital Medical Staffs
Certification
Internship and Residency
Multicenter Studies
Delivery of Health Care
Physicians
Education

Keywords

  • Assessment
  • Multiple choice examination
  • Pediatric Advanced Life Support

ASJC Scopus subject areas

  • Cardiology and Cardiovascular Medicine
  • Emergency
  • Emergency Medicine

Cite this

Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation : A report from the EXPRESS pediatric research collaborative. / Duff, Jonathan P.; Cheng, Adam; Bahry, Louise M.; Hopkins, Jeff; Richard, Matthew; Schexnayder, Steven M.; Carbonaro, Mike; Hunt, Elizabeth A.; Nadkarni, Vinay M.; Nelson-McMillan, Kristen; Donoghue, Aaron; Nishisaki, Akira; LeFlore, Judy; Eppich, Walter; Adler, Mark; Moyer, Mike; Brett-Fleegler, Marisa; Kleinman, Monica; Anderson, JoDee; Braga, Matthew; Kost, Susanne; Stryjewski, Glenn; Min, Steve; Podraza, John; Lopreiato, Joseph; Hamilton, Melinda Fiedor; Stone, Kimberly; Reid, Jennifer; Manos, Jennifer; Kappus, Liana; Leonard, Douglas; Ventre, Kathleen; Boyle, Kristine; Corbin, Laura; Festa, Marino; Overly, Frank; Sudikoff, Stephanie; Ikeyama, Takanari; Rudolph, Jenny; Simon, Robert; Boulet, John R.; Halamek, Louis P.; Gosbee, John; Gosbee, Laura.

In: Resuscitation, Vol. 84, No. 3, 03.2013, p. 365-368.

Research output: Contribution to journalArticle

Duff, JP, Cheng, A, Bahry, LM, Hopkins, J, Richard, M, Schexnayder, SM, Carbonaro, M, Hunt, EA, Nadkarni, VM, Nelson-McMillan, K, Donoghue, A, Nishisaki, A, LeFlore, J, Eppich, W, Adler, M, Moyer, M, Brett-Fleegler, M, Kleinman, M, Anderson, J, Braga, M, Kost, S, Stryjewski, G, Min, S, Podraza, J, Lopreiato, J, Hamilton, MF, Stone, K, Reid, J, Manos, J, Kappus, L, Leonard, D, Ventre, K, Boyle, K, Corbin, L, Festa, M, Overly, F, Sudikoff, S, Ikeyama, T, Rudolph, J, Simon, R, Boulet, JR, Halamek, LP, Gosbee, J & Gosbee, L 2013, 'Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: A report from the EXPRESS pediatric research collaborative', Resuscitation, vol. 84, no. 3, pp. 365-368. https://doi.org/10.1016/j.resuscitation.2012.07.018
Duff, Jonathan P. ; Cheng, Adam ; Bahry, Louise M. ; Hopkins, Jeff ; Richard, Matthew ; Schexnayder, Steven M. ; Carbonaro, Mike ; Hunt, Elizabeth A. ; Nadkarni, Vinay M. ; Nelson-McMillan, Kristen ; Donoghue, Aaron ; Nishisaki, Akira ; LeFlore, Judy ; Eppich, Walter ; Adler, Mark ; Moyer, Mike ; Brett-Fleegler, Marisa ; Kleinman, Monica ; Anderson, JoDee ; Braga, Matthew ; Kost, Susanne ; Stryjewski, Glenn ; Min, Steve ; Podraza, John ; Lopreiato, Joseph ; Hamilton, Melinda Fiedor ; Stone, Kimberly ; Reid, Jennifer ; Manos, Jennifer ; Kappus, Liana ; Leonard, Douglas ; Ventre, Kathleen ; Boyle, Kristine ; Corbin, Laura ; Festa, Marino ; Overly, Frank ; Sudikoff, Stephanie ; Ikeyama, Takanari ; Rudolph, Jenny ; Simon, Robert ; Boulet, John R. ; Halamek, Louis P. ; Gosbee, John ; Gosbee, Laura. / Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation : A report from the EXPRESS pediatric research collaborative. In: Resuscitation. 2013 ; Vol. 84, No. 3. pp. 365-368.
@article{8cc6a7ddaaec4d3ea8909823aa877899,
title = "Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: A report from the EXPRESS pediatric research collaborative",
abstract = "Introduction: Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study). Methods: Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives. Results: 435 health care professionals completed the MCQ examination with an average score of 69.3{\%}. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed. Conclusion: This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.",
keywords = "Assessment, Multiple choice examination, Pediatric Advanced Life Support",
author = "Duff, {Jonathan P.} and Adam Cheng and Bahry, {Louise M.} and Jeff Hopkins and Matthew Richard and Schexnayder, {Steven M.} and Mike Carbonaro and Hunt, {Elizabeth A.} and Nadkarni, {Vinay M.} and Kristen Nelson-McMillan and Aaron Donoghue and Akira Nishisaki and Judy LeFlore and Walter Eppich and Mark Adler and Mike Moyer and Marisa Brett-Fleegler and Monica Kleinman and JoDee Anderson and Matthew Braga and Susanne Kost and Glenn Stryjewski and Steve Min and John Podraza and Joseph Lopreiato and Hamilton, {Melinda Fiedor} and Kimberly Stone and Jennifer Reid and Jennifer Manos and Liana Kappus and Douglas Leonard and Kathleen Ventre and Kristine Boyle and Laura Corbin and Marino Festa and Frank Overly and Stephanie Sudikoff and Takanari Ikeyama and Jenny Rudolph and Robert Simon and Boulet, {John R.} and Halamek, {Louis P.} and John Gosbee and Laura Gosbee",
year = "2013",
month = "3",
doi = "10.1016/j.resuscitation.2012.07.018",
language = "English (US)",
volume = "84",
pages = "365--368",
journal = "Resuscitation",
issn = "0300-9572",
publisher = "Elsevier Ireland Ltd",
number = "3",

}

TY - JOUR

T1 - Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation

T2 - A report from the EXPRESS pediatric research collaborative

AU - Duff, Jonathan P.

AU - Cheng, Adam

AU - Bahry, Louise M.

AU - Hopkins, Jeff

AU - Richard, Matthew

AU - Schexnayder, Steven M.

AU - Carbonaro, Mike

AU - Hunt, Elizabeth A.

AU - Nadkarni, Vinay M.

AU - Nelson-McMillan, Kristen

AU - Donoghue, Aaron

AU - Nishisaki, Akira

AU - LeFlore, Judy

AU - Eppich, Walter

AU - Adler, Mark

AU - Moyer, Mike

AU - Brett-Fleegler, Marisa

AU - Kleinman, Monica

AU - Anderson, JoDee

AU - Braga, Matthew

AU - Kost, Susanne

AU - Stryjewski, Glenn

AU - Min, Steve

AU - Podraza, John

AU - Lopreiato, Joseph

AU - Hamilton, Melinda Fiedor

AU - Stone, Kimberly

AU - Reid, Jennifer

AU - Manos, Jennifer

AU - Kappus, Liana

AU - Leonard, Douglas

AU - Ventre, Kathleen

AU - Boyle, Kristine

AU - Corbin, Laura

AU - Festa, Marino

AU - Overly, Frank

AU - Sudikoff, Stephanie

AU - Ikeyama, Takanari

AU - Rudolph, Jenny

AU - Simon, Robert

AU - Boulet, John R.

AU - Halamek, Louis P.

AU - Gosbee, John

AU - Gosbee, Laura

PY - 2013/3

Y1 - 2013/3

N2 - Introduction: Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study). Methods: Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives. Results: 435 health care professionals completed the MCQ examination with an average score of 69.3%. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed. Conclusion: This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.

AB - Introduction: Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study). Methods: Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives. Results: 435 health care professionals completed the MCQ examination with an average score of 69.3%. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed. Conclusion: This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.

KW - Assessment

KW - Multiple choice examination

KW - Pediatric Advanced Life Support

UR - http://www.scopus.com/inward/record.url?scp=84875050870&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84875050870&partnerID=8YFLogxK

U2 - 10.1016/j.resuscitation.2012.07.018

DO - 10.1016/j.resuscitation.2012.07.018

M3 - Article

C2 - 22842012

AN - SCOPUS:84875050870

VL - 84

SP - 365

EP - 368

JO - Resuscitation

JF - Resuscitation

SN - 0300-9572

IS - 3

ER -