Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus

Erynne A. Faucett; Nikolaus E. Wolter; Karthik Balakrishnan; Stacey L. Ishman; Deepak Mehta; Sanjay Parikh; Lily H.P. Nguyen; Diego Preciado; Michael J. Rutter; Jeremy D. Prager; Glenn E. Green; Seth M. Pransky; Ravi Elluru; Murad Husein; Soham Roy; Kaalan E. Johnson; Jacob Friedberg; Romaine F. Johnson; Nancy M. Bauman; Charles M. Myer; Ellen S. Deutsch; Eric A. Gantwerker; J. Paul Willging; Catherine K. Hart; Robert H. Chun; Derek J. Lam; Jonathan B. Ida; John J. Manoukian; David R. White; Douglas R. Sidell; Christopher T. Wootten; Andrew F. Inglis; Craig S. Derkay; George Zalzal; David W. Molter; Jeffrey P. Ludemann; Sukgi Choi; Scott Schraff; Charles M. Myer; Robin T. Cotton; Shyan Vijayasekaran; Carlton J. Zdanski; Hamdy El-Hakim; Udayan K. Shah; Marlene A. Soma; Marshall E. Smith; Dana M. Thompson; Luv Ram Javia; Karen B. Zur; Steven E. Sobol; Christopher J. Hartnick; Reza Rahbar; Jean Philippe Vaccani; Benjamin Hartley; Sam J. Daniel; Ian N. Jacobs; Gresham T. Richter; Alessandro de Alarcon; Matthew A. Bromwich; Evan J. Propst

doi:10.1002/lary.29126

Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus

Erynne A. Faucett, Nikolaus E. Wolter, Karthik Balakrishnan, Stacey L. Ishman, Deepak Mehta, Sanjay Parikh, Lily H.P. Nguyen, Diego Preciado, Michael J. Rutter, Jeremy D. Prager, Glenn E. Green, Seth M. Pransky, Ravi Elluru, Murad Husein, Soham Roy, Kaalan E. Johnson, Jacob Friedberg, Romaine F. Johnson, Nancy M. Bauman, Charles M. MyerEllen S. Deutsch, Eric A. Gantwerker, J. Paul Willging, Catherine K. Hart, Robert H. Chun, Derek J. Lam, Jonathan B. Ida, John J. Manoukian, David R. White, Douglas R. Sidell, Christopher T. Wootten, Andrew F. Inglis, Craig S. Derkay, George Zalzal, David W. Molter, Jeffrey P. Ludemann, Sukgi Choi, Scott Schraff, Charles M. Myer, Robin T. Cotton, Shyan Vijayasekaran, Carlton J. Zdanski, Hamdy El-Hakim, Udayan K. Shah, Marlene A. Soma, Marshall E. Smith, Dana M. Thompson, Luv Ram Javia, Karen B. Zur, Steven E. Sobol, Christopher J. Hartnick, Reza Rahbar, Jean Philippe Vaccani, Benjamin Hartley, Sam J. Daniel, Ian N. Jacobs, Gresham T. Richter, Alessandro de Alarcon, Matthew A. Bromwich, Evan J. Propst

Otolaryngology

Research output: Contribution to journal › Article › peer-review

Abstract

Objectives/Hypothesis: Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal. Study Design: Blinded modified Delphi consensus process. Setting: Tertiary care center. Methods: A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as “keep” or “remove” and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items. Results: The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to “keep” all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus. Conclusions: It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated. Level of Evidence: 5. Laryngoscope, 131:1168–1174, 2021.

Original language	English (US)
Pages (from-to)	1168-1174
Number of pages	7
Journal	Laryngoscope
Volume	131
Issue number	5
DOIs	https://doi.org/10.1002/lary.29126
State	Published - May 2021

Keywords

Delphi
Esophagoscopy
OSAT
assessment
education
objective structured assessment of technical skills

ASJC Scopus subject areas

Otorhinolaryngology

Access to Document

10.1002/lary.29126

Cite this

Faucett, E. A., Wolter, N. E., Balakrishnan, K., Ishman, S. L., Mehta, D., Parikh, S., Nguyen, L. H. P., Preciado, D., Rutter, M. J., Prager, J. D., Green, G. E., Pransky, S. M., Elluru, R., Husein, M., Roy, S., Johnson, K. E., Friedberg, J., Johnson, R. F., Bauman, N. M., ... Propst, E. J. (2021). Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus. Laryngoscope, 131(5), 1168-1174. https://doi.org/10.1002/lary.29126

Competency-Based Assessment Tool for Pediatric Esophagoscopy : International Modified Delphi Consensus. / Faucett, Erynne A.; Wolter, Nikolaus E.; Balakrishnan, Karthik; Ishman, Stacey L.; Mehta, Deepak; Parikh, Sanjay; Nguyen, Lily H.P.; Preciado, Diego; Rutter, Michael J.; Prager, Jeremy D.; Green, Glenn E.; Pransky, Seth M.; Elluru, Ravi; Husein, Murad; Roy, Soham; Johnson, Kaalan E.; Friedberg, Jacob; Johnson, Romaine F.; Bauman, Nancy M.; Myer, Charles M.; Deutsch, Ellen S.; Gantwerker, Eric A.; Willging, J. Paul; Hart, Catherine K.; Chun, Robert H.; Lam, Derek J.; Ida, Jonathan B.; Manoukian, John J.; White, David R.; Sidell, Douglas R.; Wootten, Christopher T.; Inglis, Andrew F.; Derkay, Craig S.; Zalzal, George; Molter, David W.; Ludemann, Jeffrey P.; Choi, Sukgi; Schraff, Scott; Myer, Charles M.; Cotton, Robin T.; Vijayasekaran, Shyan; Zdanski, Carlton J.; El-Hakim, Hamdy; Shah, Udayan K.; Soma, Marlene A.; Smith, Marshall E.; Thompson, Dana M.; Javia, Luv Ram; Zur, Karen B.; Sobol, Steven E.; Hartnick, Christopher J.; Rahbar, Reza; Vaccani, Jean Philippe; Hartley, Benjamin; Daniel, Sam J.; Jacobs, Ian N.; Richter, Gresham T.; de Alarcon, Alessandro; Bromwich, Matthew A.; Propst, Evan J.

In: Laryngoscope, Vol. 131, No. 5, 05.2021, p. 1168-1174.

Research output: Contribution to journal › Article › peer-review

Faucett, EA, Wolter, NE, Balakrishnan, K, Ishman, SL, Mehta, D, Parikh, S, Nguyen, LHP, Preciado, D, Rutter, MJ, Prager, JD, Green, GE, Pransky, SM, Elluru, R, Husein, M, Roy, S, Johnson, KE, Friedberg, J, Johnson, RF, Bauman, NM, Myer, CM, Deutsch, ES, Gantwerker, EA, Willging, JP, Hart, CK, Chun, RH, Lam, DJ, Ida, JB, Manoukian, JJ, White, DR, Sidell, DR, Wootten, CT, Inglis, AF, Derkay, CS, Zalzal, G, Molter, DW, Ludemann, JP, Choi, S, Schraff, S, Myer, CM, Cotton, RT, Vijayasekaran, S, Zdanski, CJ, El-Hakim, H, Shah, UK, Soma, MA, Smith, ME, Thompson, DM, Javia, LR, Zur, KB, Sobol, SE, Hartnick, CJ, Rahbar, R, Vaccani, JP, Hartley, B, Daniel, SJ, Jacobs, IN, Richter, GT, de Alarcon, A, Bromwich, MA & Propst, EJ 2021, 'Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus', Laryngoscope, vol. 131, no. 5, pp. 1168-1174. https://doi.org/10.1002/lary.29126

Faucett, Erynne A. ; Wolter, Nikolaus E. ; Balakrishnan, Karthik ; Ishman, Stacey L. ; Mehta, Deepak ; Parikh, Sanjay ; Nguyen, Lily H.P. ; Preciado, Diego ; Rutter, Michael J. ; Prager, Jeremy D. ; Green, Glenn E. ; Pransky, Seth M. ; Elluru, Ravi ; Husein, Murad ; Roy, Soham ; Johnson, Kaalan E. ; Friedberg, Jacob ; Johnson, Romaine F. ; Bauman, Nancy M. ; Myer, Charles M. ; Deutsch, Ellen S. ; Gantwerker, Eric A. ; Willging, J. Paul ; Hart, Catherine K. ; Chun, Robert H. ; Lam, Derek J. ; Ida, Jonathan B. ; Manoukian, John J. ; White, David R. ; Sidell, Douglas R. ; Wootten, Christopher T. ; Inglis, Andrew F. ; Derkay, Craig S. ; Zalzal, George ; Molter, David W. ; Ludemann, Jeffrey P. ; Choi, Sukgi ; Schraff, Scott ; Myer, Charles M. ; Cotton, Robin T. ; Vijayasekaran, Shyan ; Zdanski, Carlton J. ; El-Hakim, Hamdy ; Shah, Udayan K. ; Soma, Marlene A. ; Smith, Marshall E. ; Thompson, Dana M. ; Javia, Luv Ram ; Zur, Karen B. ; Sobol, Steven E. ; Hartnick, Christopher J. ; Rahbar, Reza ; Vaccani, Jean Philippe ; Hartley, Benjamin ; Daniel, Sam J. ; Jacobs, Ian N. ; Richter, Gresham T. ; de Alarcon, Alessandro ; Bromwich, Matthew A. ; Propst, Evan J. / Competency-Based Assessment Tool for Pediatric Esophagoscopy : International Modified Delphi Consensus. In: Laryngoscope. 2021 ; Vol. 131, No. 5. pp. 1168-1174.

@article{d6ffaf09a098428f89d620f179af354a,

title = "Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus",

abstract = "Objectives/Hypothesis: Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal. Study Design: Blinded modified Delphi consensus process. Setting: Tertiary care center. Methods: A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as “keep” or “remove” and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items. Results: The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to “keep” all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus. Conclusions: It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated. Level of Evidence: 5. Laryngoscope, 131:1168–1174, 2021.",

keywords = "Delphi, Esophagoscopy, OSAT, assessment, education, objective structured assessment of technical skills",

author = "Faucett, {Erynne A.} and Wolter, {Nikolaus E.} and Karthik Balakrishnan and Ishman, {Stacey L.} and Deepak Mehta and Sanjay Parikh and Nguyen, {Lily H.P.} and Diego Preciado and Rutter, {Michael J.} and Prager, {Jeremy D.} and Green, {Glenn E.} and Pransky, {Seth M.} and Ravi Elluru and Murad Husein and Soham Roy and Johnson, {Kaalan E.} and Jacob Friedberg and Johnson, {Romaine F.} and Bauman, {Nancy M.} and Myer, {Charles M.} and Deutsch, {Ellen S.} and Gantwerker, {Eric A.} and Willging, {J. Paul} and Hart, {Catherine K.} and Chun, {Robert H.} and Lam, {Derek J.} and Ida, {Jonathan B.} and Manoukian, {John J.} and White, {David R.} and Sidell, {Douglas R.} and Wootten, {Christopher T.} and Inglis, {Andrew F.} and Derkay, {Craig S.} and George Zalzal and Molter, {David W.} and Ludemann, {Jeffrey P.} and Sukgi Choi and Scott Schraff and Myer, {Charles M.} and Cotton, {Robin T.} and Shyan Vijayasekaran and Zdanski, {Carlton J.} and Hamdy El-Hakim and Shah, {Udayan K.} and Soma, {Marlene A.} and Smith, {Marshall E.} and Thompson, {Dana M.} and Javia, {Luv Ram} and Zur, {Karen B.} and Sobol, {Steven E.} and Hartnick, {Christopher J.} and Reza Rahbar and Vaccani, {Jean Philippe} and Benjamin Hartley and Daniel, {Sam J.} and Jacobs, {Ian N.} and Richter, {Gresham T.} and {de Alarcon}, Alessandro and Bromwich, {Matthew A.} and Propst, {Evan J.}",

note = "Funding Information: This study was funded by the Jordan and Lisa Gnat Family and Bastable‐Potts Chair in Otolaryngology at SickKids and the Choi, Lo, Stronach, and Paris families. Publisher Copyright: {\textcopyright} 2020 American Laryngological, Rhinological and Otological Society Inc, {"}The Triological Society{"} and American Laryngological Association (ALA)",

year = "2021",

month = may,

doi = "10.1002/lary.29126",

language = "English (US)",

volume = "131",

pages = "1168--1174",

journal = "Laryngoscope",

issn = "0023-852X",

publisher = "John Wiley and Sons Inc.",

number = "5",

}

TY - JOUR

T1 - Competency-Based Assessment Tool for Pediatric Esophagoscopy

T2 - International Modified Delphi Consensus

AU - Faucett, Erynne A.

AU - Wolter, Nikolaus E.

AU - Balakrishnan, Karthik

AU - Ishman, Stacey L.

AU - Mehta, Deepak

AU - Parikh, Sanjay

AU - Nguyen, Lily H.P.

AU - Preciado, Diego

AU - Rutter, Michael J.

AU - Prager, Jeremy D.

AU - Green, Glenn E.

AU - Pransky, Seth M.

AU - Elluru, Ravi

AU - Husein, Murad

AU - Roy, Soham

AU - Johnson, Kaalan E.

AU - Friedberg, Jacob

AU - Johnson, Romaine F.

AU - Bauman, Nancy M.

AU - Myer, Charles M.

AU - Deutsch, Ellen S.

AU - Gantwerker, Eric A.

AU - Willging, J. Paul

AU - Hart, Catherine K.

AU - Chun, Robert H.

AU - Lam, Derek J.

AU - Ida, Jonathan B.

AU - Manoukian, John J.

AU - White, David R.

AU - Sidell, Douglas R.

AU - Wootten, Christopher T.

AU - Inglis, Andrew F.

AU - Derkay, Craig S.

AU - Zalzal, George

AU - Molter, David W.

AU - Ludemann, Jeffrey P.

AU - Choi, Sukgi

AU - Schraff, Scott

AU - Myer, Charles M.

AU - Cotton, Robin T.

AU - Vijayasekaran, Shyan

AU - Zdanski, Carlton J.

AU - El-Hakim, Hamdy

AU - Shah, Udayan K.

AU - Soma, Marlene A.

AU - Smith, Marshall E.

AU - Thompson, Dana M.

AU - Javia, Luv Ram

AU - Zur, Karen B.

AU - Sobol, Steven E.

AU - Hartnick, Christopher J.

AU - Rahbar, Reza

AU - Vaccani, Jean Philippe

AU - Hartley, Benjamin

AU - Daniel, Sam J.

AU - Jacobs, Ian N.

AU - Richter, Gresham T.

AU - de Alarcon, Alessandro

AU - Bromwich, Matthew A.

AU - Propst, Evan J.

N1 - Funding Information: This study was funded by the Jordan and Lisa Gnat Family and Bastable‐Potts Chair in Otolaryngology at SickKids and the Choi, Lo, Stronach, and Paris families. Publisher Copyright: © 2020 American Laryngological, Rhinological and Otological Society Inc, "The Triological Society" and American Laryngological Association (ALA)

PY - 2021/5

Y1 - 2021/5

N2 - Objectives/Hypothesis: Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal. Study Design: Blinded modified Delphi consensus process. Setting: Tertiary care center. Methods: A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as “keep” or “remove” and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items. Results: The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to “keep” all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus. Conclusions: It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated. Level of Evidence: 5. Laryngoscope, 131:1168–1174, 2021.

AB - Objectives/Hypothesis: Create a competency-based assessment tool for pediatric esophagoscopy with foreign body removal. Study Design: Blinded modified Delphi consensus process. Setting: Tertiary care center. Methods: A list of 25 potential items was sent via the Research Electronic Data Capture database to 66 expert surgeons who perform pediatric esophagoscopy. In the first round, items were rated as “keep” or “remove” and comments were incorporated. In the second round, experts rated the importance of each item on a seven-point Likert scale. Consensus was determined with a goal of 7 to 25 final items. Results: The response rate was 38/64 (59.4%) in the first round and returned questionnaires were 100% complete. Experts wanted to “keep” all items and 172 comments were incorporated. Twenty-four task-specific and 7 previously-validated global rating items were distributed in the second round, and the response rate was 53/64 (82.8%) with questionnaires returned 97.5% complete. Of the task-specific items, 9 reached consensus, 7 were near consensus, and 8 did not achieve consensus. For global rating items that were previously validated, 6 reached consensus and 1 was near consensus. Conclusions: It is possible to reach consensus about the important steps involved in rigid esophagoscopy with foreign body removal using a modified Delphi consensus technique. These items can now be considered when evaluating trainees during this procedure. This tool may allow trainees to focus on important steps of the procedure and help training programs standardize how trainees are evaluated. Level of Evidence: 5. Laryngoscope, 131:1168–1174, 2021.

KW - Delphi

KW - Esophagoscopy

KW - OSAT

KW - assessment

KW - education

KW - objective structured assessment of technical skills

UR - http://www.scopus.com/inward/record.url?scp=85092352714&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85092352714&partnerID=8YFLogxK

U2 - 10.1002/lary.29126

DO - 10.1002/lary.29126

M3 - Article

C2 - 33034397

AN - SCOPUS:85092352714

VL - 131

SP - 1168

EP - 1174

JO - Laryngoscope

JF - Laryngoscope

SN - 0023-852X

IS - 5

ER -

Competency-Based Assessment Tool for Pediatric Esophagoscopy: International Modified Delphi Consensus

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this