TY - JOUR
T1 - The relationship between level of training and accuracy of violence risk assessment
AU - Teo, Alan R.
AU - Holley, Sarah R.
AU - Leary, Mark
AU - McNiel, Dale E.
PY - 2012/11/1
Y1 - 2012/11/1
N2 - Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.
AB - Objective: Although clinical training programs aspire to develop competency in violence risk assessment, little research has examined whether level of training is associated with the accuracy of clinicians' evaluations of violence potential. This is the first study to compare the accuracy of risk assessments by experienced psychiatrists with those performed by psychiatric residents. It also examined the potential of a structured decision support tool to improve residents' risk assessments. Methods: The study used a retrospective case-control design. Medical records were reviewed for 151 patients who assaulted staff at a county hospital and 150 comparison patients. At admission, violence risk assessments had been completed by psychiatric residents (N=38) for 52 patients and by attending psychiatrists (N=41) for 249 patients. Trained research clinicians, who were blind to whether patients later became violent, coded information available at hospital admission by using a structured risk assessment tool - the Historical, Clinical, Risk Management-20 clinical subscale (HCR-20-C). Results: Receiver operating characteristic analyses showed that clinical estimates of violence risk by attending psychiatrists had significantly higher predictive validity than those of psychiatric residents. Risk assessments by attending psychiatrists were moderately accurate (area under the curve [AUC]=.70), whereas assessments by residents were no better than chance (AUC=.52). Incremental validity analyses showed that addition of information from the HCR-20-C had the potential to improve the accuracy of risk assessments by residents to a level (AUC=.67) close to that of attending psychiatrists. Conclusions: Having less training and experience was associated with inaccurate violence risk assessment. Structured methods hold promise for improving training in risk assessment for violence.
UR - http://www.scopus.com/inward/record.url?scp=84870048417&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84870048417&partnerID=8YFLogxK
U2 - 10.1176/appi.ps.201200019
DO - 10.1176/appi.ps.201200019
M3 - Article
C2 - 22948947
AN - SCOPUS:84870048417
SN - 1075-2730
VL - 63
SP - 1089
EP - 1094
JO - Psychiatric Services
JF - Psychiatric Services
IS - 11
ER -