State-of-the-art in biomedical literature retrieval for clinical cases: a survey of the TREC 2014 CDS track

Kirk Roberts, Matthew Simpson, Dina Demner-Fushman, Ellen Voorhees, William (Bill) Hersh

Research output: Contribution to journalArticle

23 Citations (Scopus)

Abstract

Providing access to relevant biomedical literature in a clinical setting has the potential to bridge a critical gap in evidence-based medicine. Here, our goal is specifically to provide relevant articles to clinicians to improve their decision-making in diagnosing, treating, and testing patients. To this end, the TREC 2014 Clinical Decision Support Track evaluated a system’s ability to retrieve relevant articles in one of three categories (Diagnosis, Treatment, Test) using an idealized form of a patient medical record. Over 100 submissions from over 25 participants were evaluated on 30 topics, resulting in over 37k relevance judgments. In this article, we provide an overview of the task, a survey of the information retrieval methods employed by the participants, an analysis of the results, and a discussion on the future directions for this challenging yet important task.

Original languageEnglish (US)
Pages (from-to)113-148
Number of pages36
JournalInformation Retrieval
Volume19
Issue number1-2
DOIs
StatePublished - Apr 1 2016

Fingerprint

Information retrieval
Medicine
Decision making
Testing
information retrieval
medicine
decision making
ability
evidence
literature

Keywords

  • Biomedical information retrieval
  • Clinical decision support
  • Information retrieval evaluation

ASJC Scopus subject areas

  • Information Systems
  • Library and Information Sciences

Cite this

State-of-the-art in biomedical literature retrieval for clinical cases : a survey of the TREC 2014 CDS track. / Roberts, Kirk; Simpson, Matthew; Demner-Fushman, Dina; Voorhees, Ellen; Hersh, William (Bill).

In: Information Retrieval, Vol. 19, No. 1-2, 01.04.2016, p. 113-148.

Research output: Contribution to journalArticle

Roberts, Kirk ; Simpson, Matthew ; Demner-Fushman, Dina ; Voorhees, Ellen ; Hersh, William (Bill). / State-of-the-art in biomedical literature retrieval for clinical cases : a survey of the TREC 2014 CDS track. In: Information Retrieval. 2016 ; Vol. 19, No. 1-2. pp. 113-148.
@article{6221e1fc292c4e64bca00cfb41adabfa,
title = "State-of-the-art in biomedical literature retrieval for clinical cases: a survey of the TREC 2014 CDS track",
abstract = "Providing access to relevant biomedical literature in a clinical setting has the potential to bridge a critical gap in evidence-based medicine. Here, our goal is specifically to provide relevant articles to clinicians to improve their decision-making in diagnosing, treating, and testing patients. To this end, the TREC 2014 Clinical Decision Support Track evaluated a system’s ability to retrieve relevant articles in one of three categories (Diagnosis, Treatment, Test) using an idealized form of a patient medical record. Over 100 submissions from over 25 participants were evaluated on 30 topics, resulting in over 37k relevance judgments. In this article, we provide an overview of the task, a survey of the information retrieval methods employed by the participants, an analysis of the results, and a discussion on the future directions for this challenging yet important task.",
keywords = "Biomedical information retrieval, Clinical decision support, Information retrieval evaluation",
author = "Kirk Roberts and Matthew Simpson and Dina Demner-Fushman and Ellen Voorhees and Hersh, {William (Bill)}",
year = "2016",
month = "4",
day = "1",
doi = "10.1007/s10791-015-9259-x",
language = "English (US)",
volume = "19",
pages = "113--148",
journal = "Information Retrieval",
issn = "1386-4564",
publisher = "Springer Netherlands",
number = "1-2",

}

TY - JOUR

T1 - State-of-the-art in biomedical literature retrieval for clinical cases

T2 - a survey of the TREC 2014 CDS track

AU - Roberts, Kirk

AU - Simpson, Matthew

AU - Demner-Fushman, Dina

AU - Voorhees, Ellen

AU - Hersh, William (Bill)

PY - 2016/4/1

Y1 - 2016/4/1

N2 - Providing access to relevant biomedical literature in a clinical setting has the potential to bridge a critical gap in evidence-based medicine. Here, our goal is specifically to provide relevant articles to clinicians to improve their decision-making in diagnosing, treating, and testing patients. To this end, the TREC 2014 Clinical Decision Support Track evaluated a system’s ability to retrieve relevant articles in one of three categories (Diagnosis, Treatment, Test) using an idealized form of a patient medical record. Over 100 submissions from over 25 participants were evaluated on 30 topics, resulting in over 37k relevance judgments. In this article, we provide an overview of the task, a survey of the information retrieval methods employed by the participants, an analysis of the results, and a discussion on the future directions for this challenging yet important task.

AB - Providing access to relevant biomedical literature in a clinical setting has the potential to bridge a critical gap in evidence-based medicine. Here, our goal is specifically to provide relevant articles to clinicians to improve their decision-making in diagnosing, treating, and testing patients. To this end, the TREC 2014 Clinical Decision Support Track evaluated a system’s ability to retrieve relevant articles in one of three categories (Diagnosis, Treatment, Test) using an idealized form of a patient medical record. Over 100 submissions from over 25 participants were evaluated on 30 topics, resulting in over 37k relevance judgments. In this article, we provide an overview of the task, a survey of the information retrieval methods employed by the participants, an analysis of the results, and a discussion on the future directions for this challenging yet important task.

KW - Biomedical information retrieval

KW - Clinical decision support

KW - Information retrieval evaluation

UR - http://www.scopus.com/inward/record.url?scp=84956652690&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84956652690&partnerID=8YFLogxK

U2 - 10.1007/s10791-015-9259-x

DO - 10.1007/s10791-015-9259-x

M3 - Article

AN - SCOPUS:84956652690

VL - 19

SP - 113

EP - 148

JO - Information Retrieval

JF - Information Retrieval

SN - 1386-4564

IS - 1-2

ER -