Use of simulation to assess electronic health record safety in the intensive care unit: A pilot study

Christopher A. March, David Steiger, Gretchen Scholl, Vishnu Mohan, William (Bill) Hersh, Jeffrey (Jeff) Gold

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

Objective: To establish the role of high-fidelity simulation training to test the efficacy and safety of the electronic health record (EHR)-user interface within the intensive care unit (ICU) environment. Design: Prospective pilot study. Setting: Medical ICU in an academic medical centre. Participants: Postgraduate medical trainees. Interventions: A 5-day-simulated ICU patient was developed in the EHR including labs, hourly vitals, medication administration, ventilator settings, nursing and notes. Fourteen medical issues requiring recognition and subsequent changes in management were included. Issues were chosen based on their frequency of occurrence within the ICU and their ability to test different aspects of the EHR-user interface. ICU residents, blinded to the presence of medical errors within the case, were provided a sign-out and given 10 min to review the case in the EHR. They then presented the case with their management suggestions to an attending physician. Participants were graded on the number of issues identified. All participants were provided with immediate feedback upon completion of the simulation. Primary and secondary outcomes: To determine the frequency of error recognition in an EHR simulation. To determine factors associated with improved performance in the simulation. Results: 38 participants including 9 interns, 10 residents and 19 fellows were tested. The average error recognition rate was 41% (range 6-73%), which increased slightly with the level of training (35%, 41% and 50% for interns, residents, and fellows, respectively). Over-sedation was the least-recognised error (16%); poor glycemic control was most often recognised (68%). Only 32% of the participants recognised inappropriate antibiotic dosing. Performance correlated with the total number of screens used ( p=0.03). Conclusions: Despite development of comprehensive EHRs, there remain significant gaps in identifying dangerous medical management issues. This gap remains despite high levels of medical training, suggesting that EHR-specific training may be beneficial. Simulation provides a novel tool in order to both identify these gaps as well as foster EHR-specific training.

Original languageEnglish (US)
Article numbere002549
JournalBMJ Open
Volume3
Issue number4
DOIs
StatePublished - 2013

Fingerprint

Electronic Health Records
Intensive Care Units
Safety
Medical Errors
Mechanical Ventilators
Nursing
Prospective Studies
Anti-Bacterial Agents
Physicians

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Use of simulation to assess electronic health record safety in the intensive care unit : A pilot study. / March, Christopher A.; Steiger, David; Scholl, Gretchen; Mohan, Vishnu; Hersh, William (Bill); Gold, Jeffrey (Jeff).

In: BMJ Open, Vol. 3, No. 4, e002549, 2013.

Research output: Contribution to journalArticle

@article{0dd219e221bf477598cd2d1b3da2aad5,
title = "Use of simulation to assess electronic health record safety in the intensive care unit: A pilot study",
abstract = "Objective: To establish the role of high-fidelity simulation training to test the efficacy and safety of the electronic health record (EHR)-user interface within the intensive care unit (ICU) environment. Design: Prospective pilot study. Setting: Medical ICU in an academic medical centre. Participants: Postgraduate medical trainees. Interventions: A 5-day-simulated ICU patient was developed in the EHR including labs, hourly vitals, medication administration, ventilator settings, nursing and notes. Fourteen medical issues requiring recognition and subsequent changes in management were included. Issues were chosen based on their frequency of occurrence within the ICU and their ability to test different aspects of the EHR-user interface. ICU residents, blinded to the presence of medical errors within the case, were provided a sign-out and given 10 min to review the case in the EHR. They then presented the case with their management suggestions to an attending physician. Participants were graded on the number of issues identified. All participants were provided with immediate feedback upon completion of the simulation. Primary and secondary outcomes: To determine the frequency of error recognition in an EHR simulation. To determine factors associated with improved performance in the simulation. Results: 38 participants including 9 interns, 10 residents and 19 fellows were tested. The average error recognition rate was 41{\%} (range 6-73{\%}), which increased slightly with the level of training (35{\%}, 41{\%} and 50{\%} for interns, residents, and fellows, respectively). Over-sedation was the least-recognised error (16{\%}); poor glycemic control was most often recognised (68{\%}). Only 32{\%} of the participants recognised inappropriate antibiotic dosing. Performance correlated with the total number of screens used ( p=0.03). Conclusions: Despite development of comprehensive EHRs, there remain significant gaps in identifying dangerous medical management issues. This gap remains despite high levels of medical training, suggesting that EHR-specific training may be beneficial. Simulation provides a novel tool in order to both identify these gaps as well as foster EHR-specific training.",
author = "March, {Christopher A.} and David Steiger and Gretchen Scholl and Vishnu Mohan and Hersh, {William (Bill)} and Gold, {Jeffrey (Jeff)}",
year = "2013",
doi = "10.1136/bmjopen-2013-002549",
language = "English (US)",
volume = "3",
journal = "BMJ Open",
issn = "2044-6055",
publisher = "BMJ Publishing Group",
number = "4",

}

TY - JOUR

T1 - Use of simulation to assess electronic health record safety in the intensive care unit

T2 - A pilot study

AU - March, Christopher A.

AU - Steiger, David

AU - Scholl, Gretchen

AU - Mohan, Vishnu

AU - Hersh, William (Bill)

AU - Gold, Jeffrey (Jeff)

PY - 2013

Y1 - 2013

N2 - Objective: To establish the role of high-fidelity simulation training to test the efficacy and safety of the electronic health record (EHR)-user interface within the intensive care unit (ICU) environment. Design: Prospective pilot study. Setting: Medical ICU in an academic medical centre. Participants: Postgraduate medical trainees. Interventions: A 5-day-simulated ICU patient was developed in the EHR including labs, hourly vitals, medication administration, ventilator settings, nursing and notes. Fourteen medical issues requiring recognition and subsequent changes in management were included. Issues were chosen based on their frequency of occurrence within the ICU and their ability to test different aspects of the EHR-user interface. ICU residents, blinded to the presence of medical errors within the case, were provided a sign-out and given 10 min to review the case in the EHR. They then presented the case with their management suggestions to an attending physician. Participants were graded on the number of issues identified. All participants were provided with immediate feedback upon completion of the simulation. Primary and secondary outcomes: To determine the frequency of error recognition in an EHR simulation. To determine factors associated with improved performance in the simulation. Results: 38 participants including 9 interns, 10 residents and 19 fellows were tested. The average error recognition rate was 41% (range 6-73%), which increased slightly with the level of training (35%, 41% and 50% for interns, residents, and fellows, respectively). Over-sedation was the least-recognised error (16%); poor glycemic control was most often recognised (68%). Only 32% of the participants recognised inappropriate antibiotic dosing. Performance correlated with the total number of screens used ( p=0.03). Conclusions: Despite development of comprehensive EHRs, there remain significant gaps in identifying dangerous medical management issues. This gap remains despite high levels of medical training, suggesting that EHR-specific training may be beneficial. Simulation provides a novel tool in order to both identify these gaps as well as foster EHR-specific training.

AB - Objective: To establish the role of high-fidelity simulation training to test the efficacy and safety of the electronic health record (EHR)-user interface within the intensive care unit (ICU) environment. Design: Prospective pilot study. Setting: Medical ICU in an academic medical centre. Participants: Postgraduate medical trainees. Interventions: A 5-day-simulated ICU patient was developed in the EHR including labs, hourly vitals, medication administration, ventilator settings, nursing and notes. Fourteen medical issues requiring recognition and subsequent changes in management were included. Issues were chosen based on their frequency of occurrence within the ICU and their ability to test different aspects of the EHR-user interface. ICU residents, blinded to the presence of medical errors within the case, were provided a sign-out and given 10 min to review the case in the EHR. They then presented the case with their management suggestions to an attending physician. Participants were graded on the number of issues identified. All participants were provided with immediate feedback upon completion of the simulation. Primary and secondary outcomes: To determine the frequency of error recognition in an EHR simulation. To determine factors associated with improved performance in the simulation. Results: 38 participants including 9 interns, 10 residents and 19 fellows were tested. The average error recognition rate was 41% (range 6-73%), which increased slightly with the level of training (35%, 41% and 50% for interns, residents, and fellows, respectively). Over-sedation was the least-recognised error (16%); poor glycemic control was most often recognised (68%). Only 32% of the participants recognised inappropriate antibiotic dosing. Performance correlated with the total number of screens used ( p=0.03). Conclusions: Despite development of comprehensive EHRs, there remain significant gaps in identifying dangerous medical management issues. This gap remains despite high levels of medical training, suggesting that EHR-specific training may be beneficial. Simulation provides a novel tool in order to both identify these gaps as well as foster EHR-specific training.

UR - http://www.scopus.com/inward/record.url?scp=84877715748&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877715748&partnerID=8YFLogxK

U2 - 10.1136/bmjopen-2013-002549

DO - 10.1136/bmjopen-2013-002549

M3 - Article

C2 - 23578685

AN - SCOPUS:84877715748

VL - 3

JO - BMJ Open

JF - BMJ Open

SN - 2044-6055

IS - 4

M1 - e002549

ER -