A Prospective Evaluation of an Automated Classification System to Support Evidence-based Medicine and Systematic Review

Aaron Cohen, Kyle Ambert, Marian McDonagh

Research output: Contribution to journalReview articlepeer-review

27 Scopus citations

Abstract

Systematic reviews (SR) are an important and labor-intensive part of the Evidence-based Medicine process that could benefit from automated literature classification tools. We conducted a prospective study of a support vector machine-based classifier for supporting the SR literature triage process. Over 50,000 training data samples were collected for 18 topics prior to March 2008, and used to make predictions on 11,000 test data samples collected during the subsequent two years. Test performance (AUC) was comparable to that estimated by cross-validation on the training set, and ranging from 0.75 - 0.99. Mean AUC macro-averaged across all topics was 0.89, demonstrating that these methods can achieve accurate results in near-real world conditions and are promising tools for deployment to groups conducting SRs.

Original languageEnglish (US)
Pages (from-to)121-125
Number of pages5
JournalAMIA ... Annual Symposium proceedings / AMIA Symposium. AMIA Symposium
Volume2010
StatePublished - 2010

ASJC Scopus subject areas

  • General Medicine

Fingerprint

Dive into the research topics of 'A Prospective Evaluation of an Automated Classification System to Support Evidence-based Medicine and Systematic Review'. Together they form a unique fingerprint.

Cite this