How well do physicians use electronic information retrieval systems? A framework for investigation and systematic review

William (Bill) Hersh, David H. Hickam

Research output: Contribution to journalArticle

172 Citations (Scopus)

Abstract

Objective. - Despite the proliferation of electronic information retrieval (IR) systems for physicians, their effectiveness has not been well assessed. The purpose of this review is to provide a conceptual framework and to apply the results of previous studies to this framework. Data Sources. - All sources of medical informatics and information science literature, including MEDLINE, along with bibliographies of textbooks in these areas, were searched from 1966 to January 1998. Study Selection. - All articles presenting either classifications of evaluation studies or their results, with an emphasis on those studying use by physicians. Data Extraction. - A framework for evaluation was developed, consisting of frequency of use, purpose of use, user satisfaction, searching utility, search failure, and outcomes. All studies were then assessed based on the framework. Data Synthesis. - Due to the heterogeneity and simplistic study designs, no meta- analysis of studies could be done. General conclusions were drawn from data where appropriate. A total of 47 articles were found to include an evaluation component and were used to develop the framework. Of these, 21 articles met the inclusion criteria for 1 or more of the categories in the framework. Most use of IR systems by physicians still occurs with bibliographic rather than full-text databases. Overall use of IR systems occurs just 0.3 to 9 times per physician per month, whereas physicians have 2 unanswered questions for every 3 patients. Conclusions. - Studies comparing IR systems with different searching features have not shown that advanced searching methods are significantly more effective than simple text word methods. Most searches retrieve only one fourth to one half of the relevant articles on a given topic and, once retrieved, little is known about how these articles are interpreted or applied. These studies imply that further research and development are needed to improve system utility and performance.

Original languageEnglish (US)
Pages (from-to)1347-1352
Number of pages6
JournalJournal of the American Medical Association
Volume280
Issue number15
DOIs
StatePublished - Oct 21 1998

Fingerprint

Information Systems
Physicians
Medical Informatics
Textbooks
Information Storage and Retrieval
Bibliography
MEDLINE
Meta-Analysis
Databases
Research

ASJC Scopus subject areas

  • Medicine(all)

Cite this

@article{dd4e9bb2d09c478ababd9cbcb6650627,
title = "How well do physicians use electronic information retrieval systems?: A framework for investigation and systematic review",
abstract = "Objective. - Despite the proliferation of electronic information retrieval (IR) systems for physicians, their effectiveness has not been well assessed. The purpose of this review is to provide a conceptual framework and to apply the results of previous studies to this framework. Data Sources. - All sources of medical informatics and information science literature, including MEDLINE, along with bibliographies of textbooks in these areas, were searched from 1966 to January 1998. Study Selection. - All articles presenting either classifications of evaluation studies or their results, with an emphasis on those studying use by physicians. Data Extraction. - A framework for evaluation was developed, consisting of frequency of use, purpose of use, user satisfaction, searching utility, search failure, and outcomes. All studies were then assessed based on the framework. Data Synthesis. - Due to the heterogeneity and simplistic study designs, no meta- analysis of studies could be done. General conclusions were drawn from data where appropriate. A total of 47 articles were found to include an evaluation component and were used to develop the framework. Of these, 21 articles met the inclusion criteria for 1 or more of the categories in the framework. Most use of IR systems by physicians still occurs with bibliographic rather than full-text databases. Overall use of IR systems occurs just 0.3 to 9 times per physician per month, whereas physicians have 2 unanswered questions for every 3 patients. Conclusions. - Studies comparing IR systems with different searching features have not shown that advanced searching methods are significantly more effective than simple text word methods. Most searches retrieve only one fourth to one half of the relevant articles on a given topic and, once retrieved, little is known about how these articles are interpreted or applied. These studies imply that further research and development are needed to improve system utility and performance.",
author = "Hersh, {William (Bill)} and Hickam, {David H.}",
year = "1998",
month = "10",
day = "21",
doi = "10.1001/jama.280.15.1347",
language = "English (US)",
volume = "280",
pages = "1347--1352",
journal = "JAMA - Journal of the American Medical Association",
issn = "0002-9955",
publisher = "American Medical Association",
number = "15",

}

TY - JOUR

T1 - How well do physicians use electronic information retrieval systems?

T2 - A framework for investigation and systematic review

AU - Hersh, William (Bill)

AU - Hickam, David H.

PY - 1998/10/21

Y1 - 1998/10/21

N2 - Objective. - Despite the proliferation of electronic information retrieval (IR) systems for physicians, their effectiveness has not been well assessed. The purpose of this review is to provide a conceptual framework and to apply the results of previous studies to this framework. Data Sources. - All sources of medical informatics and information science literature, including MEDLINE, along with bibliographies of textbooks in these areas, were searched from 1966 to January 1998. Study Selection. - All articles presenting either classifications of evaluation studies or their results, with an emphasis on those studying use by physicians. Data Extraction. - A framework for evaluation was developed, consisting of frequency of use, purpose of use, user satisfaction, searching utility, search failure, and outcomes. All studies were then assessed based on the framework. Data Synthesis. - Due to the heterogeneity and simplistic study designs, no meta- analysis of studies could be done. General conclusions were drawn from data where appropriate. A total of 47 articles were found to include an evaluation component and were used to develop the framework. Of these, 21 articles met the inclusion criteria for 1 or more of the categories in the framework. Most use of IR systems by physicians still occurs with bibliographic rather than full-text databases. Overall use of IR systems occurs just 0.3 to 9 times per physician per month, whereas physicians have 2 unanswered questions for every 3 patients. Conclusions. - Studies comparing IR systems with different searching features have not shown that advanced searching methods are significantly more effective than simple text word methods. Most searches retrieve only one fourth to one half of the relevant articles on a given topic and, once retrieved, little is known about how these articles are interpreted or applied. These studies imply that further research and development are needed to improve system utility and performance.

AB - Objective. - Despite the proliferation of electronic information retrieval (IR) systems for physicians, their effectiveness has not been well assessed. The purpose of this review is to provide a conceptual framework and to apply the results of previous studies to this framework. Data Sources. - All sources of medical informatics and information science literature, including MEDLINE, along with bibliographies of textbooks in these areas, were searched from 1966 to January 1998. Study Selection. - All articles presenting either classifications of evaluation studies or their results, with an emphasis on those studying use by physicians. Data Extraction. - A framework for evaluation was developed, consisting of frequency of use, purpose of use, user satisfaction, searching utility, search failure, and outcomes. All studies were then assessed based on the framework. Data Synthesis. - Due to the heterogeneity and simplistic study designs, no meta- analysis of studies could be done. General conclusions were drawn from data where appropriate. A total of 47 articles were found to include an evaluation component and were used to develop the framework. Of these, 21 articles met the inclusion criteria for 1 or more of the categories in the framework. Most use of IR systems by physicians still occurs with bibliographic rather than full-text databases. Overall use of IR systems occurs just 0.3 to 9 times per physician per month, whereas physicians have 2 unanswered questions for every 3 patients. Conclusions. - Studies comparing IR systems with different searching features have not shown that advanced searching methods are significantly more effective than simple text word methods. Most searches retrieve only one fourth to one half of the relevant articles on a given topic and, once retrieved, little is known about how these articles are interpreted or applied. These studies imply that further research and development are needed to improve system utility and performance.

UR - http://www.scopus.com/inward/record.url?scp=0032556171&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0032556171&partnerID=8YFLogxK

U2 - 10.1001/jama.280.15.1347

DO - 10.1001/jama.280.15.1347

M3 - Article

C2 - 9794316

AN - SCOPUS:0032556171

VL - 280

SP - 1347

EP - 1352

JO - JAMA - Journal of the American Medical Association

JF - JAMA - Journal of the American Medical Association

SN - 0002-9955

IS - 15

ER -