The relationship between level of training and accuracy of violence risk assessment

Alan Teo, Sarah R. Holley, Mark Leary, Dale E. McNiel

Research output: Contribution to journalArticle

12 Citations (Scopus)

Abstract

Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.

Original languageEnglish (US)
Pages (from-to)1089-1094
Number of pages6
JournalPsychiatric Services
Volume63
Issue number11
DOIs
StatePublished - Nov 1 2012
Externally publishedYes

Fingerprint

Violence
Psychiatry
Area Under Curve
Risk Management
County Hospitals
Research
ROC Curve
Medical Records
Education

ASJC Scopus subject areas

  • Psychiatry and Mental health

Cite this

The relationship between level of training and accuracy of violence risk assessment. / Teo, Alan; Holley, Sarah R.; Leary, Mark; McNiel, Dale E.

In: Psychiatric Services, Vol. 63, No. 11, 01.11.2012, p. 1089-1094.

Research output: Contribution to journalArticle

Teo, Alan ; Holley, Sarah R. ; Leary, Mark ; McNiel, Dale E. / The relationship between level of training and accuracy of violence risk assessment. In: Psychiatric Services. 2012 ; Vol. 63, No. 11. pp. 1089-1094.
@article{51e8e1339c484f6ab7bab37476782337,
title = "The relationship between level of training and accuracy of violence risk assessment",
abstract = "Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.",
author = "Alan Teo and Holley, {Sarah R.} and Mark Leary and McNiel, {Dale E.}",
year = "2012",
month = "11",
day = "1",
doi = "10.1176/appi.ps.201200019",
language = "English (US)",
volume = "63",
pages = "1089--1094",
journal = "Psychiatric Services",
issn = "1075-2730",
publisher = "American Psychiatric Association",
number = "11",

}

TY - JOUR

T1 - The relationship between level of training and accuracy of violence risk assessment

AU - Teo, Alan

AU - Holley, Sarah R.

AU - Leary, Mark

AU - McNiel, Dale E.

PY - 2012/11/1

Y1 - 2012/11/1

N2 - Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.

AB - Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.

UR - http://www.scopus.com/inward/record.url?scp=84870048417&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870048417&partnerID=8YFLogxK

U2 - 10.1176/appi.ps.201200019

DO - 10.1176/appi.ps.201200019

M3 - Article

VL - 63

SP - 1089

EP - 1094

JO - Psychiatric Services

JF - Psychiatric Services

SN - 1075-2730

IS - 11

ER -