TY - JOUR
T1 - Psychometric properties of measures of substance use
T2 - A systematic review and meta-analysis of reliability, validity and diagnostic test accuracy
AU - Santos, Glenn Milo
AU - Strathdee, Steffanie A.
AU - El-Bassel, Nabila
AU - Patel, Poonam
AU - Subramanian, Divya
AU - Horyniak, Danielle
AU - Cook, Ryan R.
AU - McCullagh, Charlotte
AU - Marotta, Phillip
AU - Choksi, Foram
AU - Kang, Brian
AU - Allen, Isabel
AU - Shoptaw, Steven
N1 - Publisher Copyright:
© 2020 The Author(s).
PY - 2020/5/7
Y1 - 2020/5/7
N2 - Background: Synthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse. Methods: We conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models. Results: Findings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent. Conclusion: We conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality.
AB - Background: Synthesis of psychometric properties of substance use measures to identify patterns of use and substance use disorders remains limited. To address this gap, we sought to systematically evaluate the psychometric properties of measures to detect substance use and misuse. Methods: We conducted a systematic review and meta-analysis of literature on measures of substance classes associated with HIV risk (heroin, methamphetamine, cocaine, ecstasy, alcohol) that were published in English before June 2016 that reported at least one of the following psychometric outcomes of interest: internal consistency (alpha), test-retest/inter-rater reliability (kappa), sensitivity, specificity, positive predictive value, and negative predictive value. We used meta-analytic techniques to generate pooled summary estimates for these outcomes using random effects and hierarchical logistic regression models. Results: Findings across 387 paper revealed that overall, 65% of pooled estimates for alpha were in the range of fair-to-excellent; 44% of estimates for kappa were in the range of fair-to-excellent. In addition, 69, 97, 37 and 96% of pooled estimates for sensitivity, specificity, positive predictive value, and negative predictive value, respectively, were in the range of moderate-to-excellent. Conclusion: We conclude that many substance use measures had pooled summary estimates that were at the fair/moderate-to-excellent range across different psychometric outcomes. Most scales were conducted in English, within the United States, highlighting the need to test and validate these measures in more diverse settings. Additionally, the majority of studies had high risk of bias, indicating a need for more studies with higher methodological quality.
KW - Alcohol
KW - Drugs
KW - Meta-analysis
KW - Psychometric properties
KW - Substance use
UR - http://www.scopus.com/inward/record.url?scp=85084393205&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85084393205&partnerID=8YFLogxK
U2 - 10.1186/s12874-020-00963-7
DO - 10.1186/s12874-020-00963-7
M3 - Article
C2 - 32380951
AN - SCOPUS:85084393205
SN - 1471-2288
VL - 20
JO - BMC Medical Research Methodology
JF - BMC Medical Research Methodology
IS - 1
M1 - 106
ER -