Towards new measures of information retrieval evaluation.

William (Bill) Hersh, Diane Elliot, D. H. Hickam, S. L. Wolf, A. Molnar, C. Leichtenstien

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.

Original languageEnglish (US)
Pages (from-to)895-899
Number of pages5
JournalProceedings / the . Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care
StatePublished - 1994

Fingerprint

Information Storage and Retrieval
Information Systems
Medical Students
Students

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{2b5bf9e5ac074f51910b39b3b6e09077,
title = "Towards new measures of information retrieval evaluation.",
abstract = "All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.",
author = "Hersh, {William (Bill)} and Diane Elliot and Hickam, {D. H.} and Wolf, {S. L.} and A. Molnar and C. Leichtenstien",
year = "1994",
language = "English (US)",
pages = "895--899",
journal = "Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care",
issn = "0195-4210",

}

TY - JOUR

T1 - Towards new measures of information retrieval evaluation.

AU - Hersh, William (Bill)

AU - Elliot, Diane

AU - Hickam, D. H.

AU - Wolf, S. L.

AU - Molnar, A.

AU - Leichtenstien, C.

PY - 1994

Y1 - 1994

N2 - All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.

AB - All of the methods currently used to assess information retrieval (IR) systems have limitations in their ability to measure how well users are able to acquire information. We utilized a new approach to assessing information obtained, based on a short-answer test given to senior medical students. Students took the ten-question test and then searched one of two IR systems on the five questions for which they were least certain of their answer Our results showed that pre-searching scores on the test were low but that searching yielded a high proportion of answers with both systems. These methods are able to measure information obtained, and will be used in subsequent studies to assess differences among IR systems.

UR - http://www.scopus.com/inward/record.url?scp=0028250706&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0028250706&partnerID=8YFLogxK

M3 - Article

C2 - 7950053

AN - SCOPUS:0028250706

SP - 895

EP - 899

JO - Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care

JF - Proceedings / the ... Annual Symposium on Computer Application [sic] in Medical Care. Symposium on Computer Applications in Medical Care

SN - 0195-4210

ER -