TY - JOUR
T1 - A web-based team-oriented medical error communication assessment tool
T2 - Development, preliminary reliability, validity, and user ratings
AU - Kim, Sara
AU - Brock, Doug
AU - Prouty, Carolyn D.
AU - Odegard, Peggy Soule
AU - Shannon, Sarah E.
AU - Robins, Lynne
AU - Boggs, Jim G.
AU - Clark, Fiona J.
AU - Gallagher, Thomas
PY - 2011/1/14
Y1 - 2011/1/14
N2 - Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. Description: We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Evaluation:Using valid data from78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on theLikert-scale questions and ranged from α =.79 to α =.89 for each set of 7 Likerttype discussion/planning items and from α =.70 to α =.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r =.59 for discussion/planning and r =.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Conclusions: Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.
AB - Multiple-choice exams are not well suited for assessing communication skills. Standardized patient assessments are costly and patient and peer assessments are often biased. Web-based assessment using video content offers the possibility of reliable, valid, and cost-efficient means for measuring complex communication skills, including interprofessional communication. Description: We report development of the Web-based Team-Oriented Medical Error Communication Assessment Tool, which uses videotaped cases for assessing skills in error disclosure and team communication. Steps in development included (a) defining communication behaviors, (b) creating scenarios, (c) developing scripts, (d) filming video with professional actors, and (e) writing assessment questions targeting team communication during planning and error disclosure. Evaluation:Using valid data from78 participants in the intervention group, coefficient alpha estimates of internal consistency were calculated based on theLikert-scale questions and ranged from α =.79 to α =.89 for each set of 7 Likerttype discussion/planning items and from α =.70 to α =.86 for each set of 8 Likert-type disclosure items. The preliminary test-retest Pearson correlation based on the scores of the intervention group was r =.59 for discussion/planning and r =.25 for error disclosure sections, respectively. Content validity was established through reliance on empirically driven published principles of effective disclosure as well as integration of expert views across all aspects of the development process. In addition, data from 122 medicine and surgical physicians and nurses showed high ratings for video quality (4.3 of 5.0), acting (4.3), and case content (4.5). Conclusions: Web assessment of communication skills appears promising. Physicians and nurses across specialties respond favorably to the tool.
UR - http://www.scopus.com/inward/record.url?scp=78751513593&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=78751513593&partnerID=8YFLogxK
U2 - 10.1080/10401334.2011.536896
DO - 10.1080/10401334.2011.536896
M3 - Article
C2 - 21240787
AN - SCOPUS:78751513593
VL - 23
SP - 68
EP - 77
JO - Teaching and Learning in Medicine
JF - Teaching and Learning in Medicine
SN - 1040-1334
IS - 1
ER -