Abstract
Objectives. The authors sought to develop a conceptual framework for evaluating whether existing information technologies and decision support systems (IT/DSSs) would assist the key decisions faced by clinicians and public health officials preparing for and responding to bioterrorism. Methods. They reviewed reports of natural and bioterrorism-related infectious outbreaks, bioterrorism preparedness exercises, and advice from experts to identify the key decisions, tasks, and information needs of clinicians and public health officials during a bioterrorism response. The authors used task decomposition to identify the subtasks and data requirements of IT/DSSs designed to facilitate a bioterrorism response. They used the results of the task decomposition to develop evaluation criteria for IT/DSSs for bioterrorism preparedness. They then applied these evaluation criteria to 341 reports of 217 existing lT/DSSs that could be used to support a bioterrorism response. Main Results. In response to bioterrorism, clinicians must make decisions in 4 critical domains (diagnosis, management, prevention, and reporting to public health), and public health officials must make decisions in 4 other domains (interpretation of bioterrorism surveillance data, outbreak investigation, outbreak control, and communication). The time horizons and utilityfunctions for these decisions differ. From the task decomposition, the authors identified critical subtasks for each of the 8 decisions. For example, interpretation of diagnostic tests is an important subtask of diagnostic decision making that requires an understanding of the tests' sensitivity and specificity. Therefore, an evaluation criterion applied to reports of diagnostic IT/DSSs for bioterrorism asked whether the reports described the systems' sensitivity and specificity. Of the 217 existing IT/DSSs that could be used to respond to bioterrorism, 79 studies evaluated 58 systems for at least 1 performance metric. Conclusions. The authors identified 8 key decisions that clinicians and public health officials must make in response to bioterrorism. When applying the evaluation system to 217 currently available IT/DSSs that could potentially support the decisions of clinicians and public health officials, the authors found that the literature provides little information about the accuracy of these systems.
Original language | English (US) |
---|---|
Pages (from-to) | 192-206 |
Number of pages | 15 |
Journal | Medical Decision Making |
Volume | 24 |
Issue number | 2 |
DOIs | |
State | Published - Mar 2004 |
Externally published | Yes |
Keywords
- Bioterrorism
- Decision support techniques
- Expert system
- Information systems
- Public health
ASJC Scopus subject areas
- Health Policy
Access to Document
Other files and links
Fingerprint Dive into the research topics of 'A Conceptual Framework for Evaluating Information Technologies and Decision Support Systems for Bioterrorism Preparedness and Response'. Together they form a unique fingerprint.
Cite this
- APA
- Standard
- Harvard
- Vancouver
- Author
- BIBTEX
- RIS
A Conceptual Framework for Evaluating Information Technologies and Decision Support Systems for Bioterrorism Preparedness and Response. / Bravata, Dena M.; McDonald, Kathryn M.; Szeto, Herbert; Smith, Wendy M.; Rydzak, Chara; Owens, Douglas K.
In: Medical Decision Making, Vol. 24, No. 2, 03.2004, p. 192-206.Research output: Contribution to journal › Article › peer-review
}
TY - JOUR
T1 - A Conceptual Framework for Evaluating Information Technologies and Decision Support Systems for Bioterrorism Preparedness and Response
AU - Bravata, Dena M.
AU - McDonald, Kathryn M.
AU - Szeto, Herbert
AU - Smith, Wendy M.
AU - Rydzak, Chara
AU - Owens, Douglas K.
N1 - Funding Information: Bravata Dena M. MD, MS Center for Primary Care and Outcomes Research, Stanford University, Stanford, California McDonald Kathryn M. MM Center for Primary Care and Outcomes Research, Stanford University, Stanford, California Szeto Herbert MD, MS, MPH Department of Internal Medicine, Kaiser Permanente, Redwood City, California Smith Wendy M. BA Center for Primary Care and Outcomes Research, Stanford University, Stanford, California Rydzak Chara BA Center for Primary Care and Outcomes Research, Stanford University, Stanford, California Owens Douglas K. MD, MS Center for Primary Care and Outcomes Research, Stanford University, Stanford, California, Veterans Affairs Palo Alto Healthcare System, Palo Alto, California, Department of Health Research & Policy, Stanford University School of Medicine, Stanford, California 03 2004 24 2 192 206 2004 Objectives . The authors sought to develop a conceptual framework for evaluating whether existing information technologies and decision support systems (IT/DSSs) would assist the key decisions faced by clinicians and public health officials preparing for and responding to bioterrorism. Methods. They reviewed reports of natural and bioterrorism related infectious outbreaks, bioterrorism preparedness exercises, and advice from experts to identify the key decisions, tasks, and information needs of clinicians and public health officials during a bioterrorism response. The authors used task decomposition to identify the subtasks and data requirements of IT/DSSs designed to facilitate a bioterrorism response. They used the results of the task decomposition to develop evaluation criteria for IT/DSSs for bioterrorism preparedness. They then applied these evaluation criteria to 341 reports of 217 existing IT/DSSs that could be used to support a bioterrorism response. Main Results . In response to bioterrorism, clinicians must make decisions in 4 critical domains (diagnosis, management, prevention, and reporting to public health), and public health officials must make decisions in 4 other domains (interpretation of bioterrorism surveillance data, outbreak investigation, outbreak control, and communication). The time horizons and utility functions for these decisions differ. From the task decomposition, the authors identified critical subtasks for each of the 8 decisions. For example, interpretation of diagnostic tests is an important subtask of diagnostic decision making that requires an understanding of the tests’ sensitivity and specificity. Therefore, an evaluation criterion applied to reports of diagnostic IT/DSSs for bioterrorism asked whether the reports described the systems’ sensitivity and specificity. Of the 217 existing IT/DSSs that could be used to respond to bioterrorism, 79 studies evaluated 58 systems for at least 1 performance metric. Conclusions. The authors identified 8 key decisions that clinicians and public health officials must make in response to bioterrorism. When applying the evaluation system to 217 currently available IT/DSSs that could potentially support the decisions of clinicians and public health officials, the authors found that the literature provides little information about the accuracy of these systems. decision support techniques bioterrorism public health information systems expert system hwp-legacy-fpage 192 hwp-legacy-dochead Journal Article 1. Jernigan JA, Stephens DS, Ashford DA, et al. Bioterrorism-related inhalational anthrax: the first 10 cases reported in the United States. Emerg Infect Dis . 2001 ; 7 : 933 -944. 2. Update: investigation of bioterrorism-related inhalational anthrax—Connecticut, 2001. MMWR Morb Mortal Wkly Rep . 2001 ; 50 : 1049 -1051. 3. Update: investigation of bioterrorism-related anthrax and interim guidelines for clinical evaluation of persons with possible anthrax. MMWR Morb Mortal Wkly Rep . 2001 ; 50 : 941 -948. 4. Update: investigation of bioterrorism-related anthrax and interim guidelines for exposure management and antimicrobial therapy, October 2001. MMWR Morb Mortal Wkly Rep . 2001 ; 50 : 909 -919. 5. Recognition of illness associated with the intentional release of a biologic agent. MMWR Morb Mortal Wkly Rep . 2001 ; 50 : 893 -897. 6. Update: investigation of anthrax associated with intentional exposure and interim public health guidelines, October 2001. MMWR Morb Mortal Wkly Rep . 2001 ; 50 : 889 -893. 7. Becker C. 20/20 hindsight: months after anthrax claimed the lives of several Americans, hospitals review their reaction to the event—and plan for future crises. Mod Healthc . 2002 ; 32 : 8 -9, 12 . 8. Borio L, Frank D, Mani V, et al. Death due to bioterrorism-related inhalational anthrax: report of 2 patients. JAMA . 2001 ; 286 : 2554 -2559. 9. Josefson D. Toll of anthrax cases reaches 15. BMJ . 2001 ; 323 : 1022 . 10. Mayer TA, Bersoff-Matcha S, Murphy C, et al. Clinical presentation of inhalational anthrax following bioterrorism exposure: report of 2 surviving patients. JAMA . 2001 ; 286 : 2549 -2553. 11. Bravata DM, McDonald K, Owens DK, et al. Bioterrorism Preparedness and Response: Use of Information Technologies and Decision Support Systems (Evidence Report/Technology Assessment No. 59). Rockville (MD): Prepared by the UCSF-Stanford Evidence-Based Practice Center under contract No. 290-97-0013 for the Agency for Healthcare Research and Quality; June 2002 . 12. Anderson JG, Aydin CE, Jay SJ, eds. Evaluating Health Care Information Systems: Methods and Applications. Thousand Oaks (CA): Sage; 1994 . 13. Friedman CP, Wyatt JC. Evaluation Methods in Medical Informatics. New York: Springer-Verlag; 1997 . 14. Owens DK, Bravata DM. Computer-based decision support: wishing on a star? Eff Clin Pract . 2001 ; 4 : 34 -38. 15. Kaplan B. Evaluating informatics applications—clinical decision support systems literature review. Int J Med Inf . 2001 ; 64 : 15 -37. 16. Ammenwerth E, Graber S, Herrmann G, Burkle T, Konig J. Evaluation of health information systems—problems and challenges. Int J Med Inf . 2003 ; 71 : 125 -135. 17. Goldratt EM. Theory of Constraints. Great Barrington (MA): North River Press; 1990 . 18. Hunink MGM. In search of tools to aid logical thinking and communicating about medical decision making. Med Decis Making . 2001 ; 21 : 267 -277. 19. Friedman CP, Owens DK,Wyatt JC. Evaluation and technology assessment. In: Shortliffe EH, Perreault LE, Wiederhold G, Fagan LM, eds. Medical Informatics: Computer Applications in Health Care and Biomedicine. New York: Springer-Verlag; 2000 . 20. Donabedian A. Exporations in Quality Assessment and Monitoring. Volume 2. Ann Arbor (MI): Health Administration Press; 1982 . 21. Donabedian A. The quality of care: how can it be assessed? JAMA . 1988 ; 260 : 1743 -1748. 22. Sim I, Owens DK, Lavori PW, Rennels GD. Electronic trial banks: a complementary method for reporting randomized trials. Med Decis Making . 2000 ; 20 : 440 -450. 23. Nease RF Jr, Owens DK. Use of influence diagrams to structure medical decisions. Med Decis Making . 1997 ; 17 : 263 -275. 24. Owens DK, Shachter RD, Nease RF. Representation and analysis of medical decision problems with influence diagrams. Med Decis Making . 1997 ; 17 : 241 -262. 25. Callan K. Preparing for a decision support system. Top Health Inf Manage . 2000 ; 21 : 84 -90. 26. Shortliffe EH. Computer programs to support clinical decision making. JAMA . 1987 ; 258 : 61 -66. 27. Inglesby T, Grossman R, O’Toole T. A Plague on Your City: Observations from TOPOFF. Center for Civilian Biodefense Studies, Johns Hopkins University. Available from: http://www.hopkinsbiodefense.org/pages/news/quarter.html#Anchor-8398 . Accessed 20 December 2000 . 28. Hoffman RE, Norton JE. Lessons learned from a full-scale bioterrorism exercise. Emerg Infect Dis . 2000 ; 6 : 652 -653. 29.Dark Winter. Johns Hopkins Center for Civilian Biodefense, Center for Strategic and International Studies, ANSER, and Memorial Institute for the Prevention of Terrorism. Available from: http://www.hopkins-biodefense.org/participants.html. Accessed 8 November 2001 . 30. MacKenzie WR, Schell WL, Blair KA, et al. Massive outbreak of waterborne cryptosporidium infection in Milwaukee, Wisconsin: recurrence of illness and risk of secondary transmission. Clin Infect Dis . 1995 ; 21 : 57 -62. 31. Outbreak of West Nile-like viral encephalitis—New York, 1999. MMWR Morb Mortal Wkly Rep. 1999;48):845-9. 32. Dennis DT, Inglesby TV, Henderson DA, et al. Tularemia as a biological weapon: medical and public health management. JAMA . 2001 ; 285 : 2763 -2773. 33. Arnon SS, Schechter R, Inglesby TV, et al. Botulinum toxin as a biological weapon: medical and public health management. JAMA . 2001 ; 285 : 1059 -1070. 34. Inglesby TV, Dennis DT, Henderson DA, et al. Plague as a biological weapon: medical and public health management. JAMA . 2000 ; 283 : 2281 -2290. 35. Henderson DA, Inglesby TV, Bartlett JG, et al. Smallpox as a biological weapon: medical and public health management. JAMA . 1999 ; 281 : 2127 -2137. 36. Inglesby TV, Henderson DA, Bartlett JG, et al. Anthrax as a biological weapon: medical and public health management. JAMA . 1999 ; 281 : 1735 -1745. 37. Bioterrorism readiness plan—a template for healthcare facilities. Association for Professionals in Infection Control and Epidemiology Inc. and Centers for Disease Control and Prevention. ED Manag . 1999 ; 11 Suppl: 1 -16. 38. Proceedings of the National Symposium on Medical and Public Health Response to Bioterrorism. Arlington, Virginia, USA. February 16-17, 1999. Emerg Infect Dis. 1999;5: 491 -592. 39. Smithson AE, Levy L. Ataxia: The Chemical and Biological Terrorism Threat and the U.S. Response. Washington (DC): Henry L. Stimson Center; 1999 . 40. ReddiNet information binder. Los Angeles (CA): Healthcare Association of Southern California; 2001 . 41. Centers for Disease Control and Prevention. Health Level Seven Specifications for Electronic Laboratory-Based Reporting of Public Health Information. Atlanta (GA): Centers for Disease Control and Prevention; 1997 . 42. Electronic reporting of laboratory information for public health. Paper presented at the Conference on Electronic Reporting of Laboratory Information for Public Health, Centers for Disease Control and Prevention; 7-8 January 1999. 43. US Department of Health and Human Services. Public Health Conceptual Data Model. Atlanta (GA): US Department of Health and Human Services, Public Health Service; 2000 . 44. Centers for Disease Control and Prevention. Secure Data Network Standards And Procedures. Atlanta (GA): Centers for Disease Control and Prevention, Agency for Toxic Substances and Disease Registry; 1999 . 45. Owens DK, Nease RF. A normative analytic framework for development of practice guidelines for specific clinical populations. Med Decis Making . 1997 ; 17 : 409 -426. 46. Owens DK, Nease RF. Development of outcome-based practice guidelines: a method for structuring problems and synthesizing evidence. Jt Comm J Qual Improv . 1993 ; 19 : 248 -263. 47. Xiang Y, Poh KL. Time-critical dynamic decision modeling in medicine. Comput Biol Med . 2002 ; 32 : 85 -97. 48. Aliferis CF, Cooper GF, Pollack ME, Buchanan BG, Wagner MM. Representing and developing temporally abstracted knowledge as a means towards facilitating time modeling in medical decision-support systems. Comput Biol Med . 1997 ; 27 : 411 -434. 49. Hazen GB. Stochastic trees and the StoTree modeling environment: models and software for medical decision analysis. J Med Syst . 2002 ; 26 : 399 -413. 50. Hazen GB. Factored stochastic trees: a tool for solving complex temporal medical decision models. Med Decis Making . 1993 ; 13 : 227 -236. 51. Hazen GB. Stochastic trees: a new technique for temporal medical decision modeling. Med Decis Making . 1992 ; 12 : 163 -178. 52. Magni P, Quaglini S, Marchetti M, Barosi G. Deciding when to intervene: a Markov decision process approach. Int J Med Inf . 2000 ; 60 : 237 -253. 53. Sim I, Owens D, Lavori P, Rennels G. Electronic trial banks: a complementary method for reporting randomized trials. Med Decis Making . 2000 ; 20 : 440 -450. 54. Chandrasekaran B, Johnson T. Generic tasks and task structure: history, critique and new directions. In: David J, Krivine J, Simmons R, eds. Second-Generation Expert Systems. New York: Springer Verlag; 1993 . p. 232 -272. 55. Gruninger M, Fox M. Methodology for the design and evaluation of ontologies. Toronto (Canada): Department of Industrial Engineering; 1995 . 56. Guidelines for evaluating surveillance systems. MMWR Morb Mortal Wkly Rep . 1988 ; 37 Suppl 5: 1 -18. 57. Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computerbased clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA . 1998 ; 280 : 1339 -1346. 58. Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer-based clinical decision support systems on clinician performance and patient outcome: a critical appraisal of research. Ann Intern Med . 1994 ; 120 : 135 -142. 59. Hornberger J, Goldstein MK. Clinical decision-support systems: evaluating the evaluation. Med Decis Making . 2000 ; 20 : 130 -131. 60. Sox HC, Blatt MA, Higgins MC, Marton KI. Medical Decision Making. Boston: Butterworth-Heinemann; 1988 . 61. Adlassnig KP, Scheithauer W. Performance evaluation of medical expert systems using ROC curves. Comput Biomed Res . 1989 ; 22 : 297 -313. 62. Sosin DM. Draft framework for evaluating syndromic surveillance systems. J Urban Health . 2003 ; 80 Suppl 1: I8 -I13. 63. Berner ES, Webster GD, Shugerman AA, et al. Performance of four computer-based diagnostic systems. N Engl J Med . 1994 ; 330 : 1792 -1796. 64. Bankowitz RA, Blumenfeld BH, Giuse BN. User variability in abstracting and entering printed case histories with Quick Medical Reference (QMR). Proceedings of the Annual Symposium on Computer Applications in Medical Care; 1987. p 68 -73. 65. Bankowitz RA, Miller JK, Janosky J. A prospective analysis of inter-rater agreement between a physician and a physician’s assistant in selecting QMR vocabulary terms. Proceedings of the Annual Symposium on Computer Applications in Medical Care; 1991. p 609 -613. 66. Lemaire JB, Schaefer JP, Martin LA, Faris P, Ainslie MD, Hull RD. Effectiveness of the Quick Medical Reference as a diagnostic tool. CMAJ . 1999 ; 161 : 725 -728. 67. Bankowitz RA, McNeil MA, Challinor SM, Parker RC, Kapoor WN, Miller RA. A computer-assisted medical diagnostic consultation service. Implementation and prospective evaluation of a prototype. Ann Intern Med . 1989 ; 110 : 824 -832. 68. Bankowitz RA, McNeil MA, Challinor SM, Miller RA. Effect of a computer-assisted general medicine diagnostic consultation service on housestaff diagnostic strategy. Methods Inf Med . 1989 ; 28 : 352 -356. 69. Arene I, Ahmed W, Fox M, Barr CE, Fisher K. Evaluation of quick medical reference (QMR) as a teaching tool. MD Comput . 1998 ; 15 : 323 -326. 70. Miller RA, McNeil MA, Challinor SM, Masarie FE Jr, Myers JD. The INTERNIST-1/Quick Medical Reference project—status report. West J Med . 1986 ; 145 : 816 -822. 71. Miller R, Masarie FE, Myers JD. Quick medical reference (QMR) for diagnostic assistance. MD Comput . 1986 ; 3 : 34 -48. 72. Bacchus CM, Quiston C, O’Rourke K, Detsky AS. A randomized crossover trial of QMR as a teaching tool for medical interns. J Gen Intern Med . 1994 ; 9 : 616 -621. 73. Berner ES, Maisiak RS. Influence of case and physician characteristics on perceptions of decision support systems. J Am Med Inform Assoc . 1999 ; 6 : 428 -434. 74. Berner ES, Maisiak RS, Cobbs CG, Taunton OD. Effects of a decision support system on physicians’ diagnostic performance. J Am Med Inform Assoc . 1999 ; 6 : 420 -427. 75. Quick Medical Reference. First Data Bank. Available from: http://www.firstdatabank.com. Accessed 14 November 2001 . 76. Fiszman M, Haug PJ. Using medical language processing to support real-time evaluation of pneumonia guidelines. Proceedings of the AMIA Annual Symposium. 2000;27: 235 -239. 77. Aronsky D, Haug PJ. An integrated decision support system for diagnosing and managing patients with community-acquired pneumonia. Proceedings of the AMIA Annual Symposium; 1999. p 197 - 201. 78. Evans RS, Larsen RA, Burke JP, et al. Computer surveillance of hospital-acquired infections and antibiotic use. JAMA . 1986 ; 256 : 1007 -1011. 79. Evans RS, Classen DC, Pestotnik SL, Lundsgaarde HP, Burke JP. Improving empiric antibiotic selection using computer decision support. Arch Intern Med . 1994 ; 154 : 878 -884. 80. Evans RS, Pestotnik SL, Classen DC, et al. A computer-assisted management program for antibiotics and other antiinfective agents. N Engl J Med . 1998 ; 338 : 232 -238. 81. Pestotnik SL, Evans RS, Burke JP, Gardner RM, Classen DC. Therapeutic antibiotic monitoring: surveillance using a computerized expert system. Am J Med . 1990 ; 88 : 43 -48. 82. Pestotnik SL, Classen DC, Evans RS, Burke JP. Implementing antibiotic practice guidelines through computer-assisted decision support: clinical and financial outcomes. Ann Intern Med . 1996 ; 124 : 884 -890. 83. Hall B. Director, Rapid Health Electronic Alert, Communications, and Training System (RHEACTS). In: Bravata DM, McDonald K, Owens DK, et al. Bioterrorism Preparedness and Response: Use of Information Technologies and Decision Support Systems (Evidence Report/Technology Assessment No. 59). Rockville (MD): Prepared by the UCSF-Stanford Evidence-Based Practice Center under contract No. 290-97-0013 for the Agency for Healthcare Research and Quality; June 2002 . 84. Ascher MS. In: Bravata DM, McDonald K, Owens DK, et al. Bioterrorism Preparedness and Response: Use of Information Technologies and Decision Support Systems (Evidence Report/Technology AssessmentNo. 59). Rockville (MD): Prepared by the UCSF-Stanford Evidence-Based Practice Center under contract No. 290-97-0013 for the Agency for Healthcare Research and Quality; June 2002 . 85. California State Senate Committee on Health and Human Services. Bioterrorism and public health: assessing California’s preparedness: background. Available from: http://www.sen.ca.gov/ftp/SEN/COMMITTEE/STANDING/HEALTH/_home/BIOTERRORISM_BACKGROUND.DOC. Accessed 13 February 2002 . 86. Pavlin JA, Kelley PW. ESSENCE: Electronic Surveillance System for the Early Notification of Community-Based Epidemics. Silver Spring (MD): US Department of Defense, Global Emerging Infections Surveillance and Response System; 2001 . 87. Centers for Disease Control and Prevention. WONDER Logon. Available from: http://wonder.cdc.gov/ . Accessed 5 October 2001 . 88. Friede A, Reid JA, Ory HW. CDC WONDER: a comprehensive online public health information system of the Centers for Disease Control and Prevention. Am J Public Health . 1993 ; 83 : 1289 -1294. 89. Friede A, Rosen DH, Reid JA. CDC WONDER: a cooperative processing architecture for public health. J Am Med Inform Assoc . 1994 ; 1 : 303 -312. 90. Ross JJ, Shapiro DS. Evaluation of the computer program GIDEON (Global Infectious Disease and Epidemiology Network) for the diagnosis of fever in patients admitted to a medical service. Clin Infect Dis . 1998 ; 26 : 766 -767. 91. International Society of Travel Medicine. Geo Sentinel: surveillance strategy. Available from: http://www.istm.org/geosentinel/surveill.html. Accessed 21 September 2001 . 92. International Society of Travel Medicine. Geo Sentinel: objectives. Available from: http://www.istm.org/geosentinel/objectiv.html. Accessed 21 September 2001 .
PY - 2004/3
Y1 - 2004/3
N2 - Objectives. The authors sought to develop a conceptual framework for evaluating whether existing information technologies and decision support systems (IT/DSSs) would assist the key decisions faced by clinicians and public health officials preparing for and responding to bioterrorism. Methods. They reviewed reports of natural and bioterrorism-related infectious outbreaks, bioterrorism preparedness exercises, and advice from experts to identify the key decisions, tasks, and information needs of clinicians and public health officials during a bioterrorism response. The authors used task decomposition to identify the subtasks and data requirements of IT/DSSs designed to facilitate a bioterrorism response. They used the results of the task decomposition to develop evaluation criteria for IT/DSSs for bioterrorism preparedness. They then applied these evaluation criteria to 341 reports of 217 existing lT/DSSs that could be used to support a bioterrorism response. Main Results. In response to bioterrorism, clinicians must make decisions in 4 critical domains (diagnosis, management, prevention, and reporting to public health), and public health officials must make decisions in 4 other domains (interpretation of bioterrorism surveillance data, outbreak investigation, outbreak control, and communication). The time horizons and utilityfunctions for these decisions differ. From the task decomposition, the authors identified critical subtasks for each of the 8 decisions. For example, interpretation of diagnostic tests is an important subtask of diagnostic decision making that requires an understanding of the tests' sensitivity and specificity. Therefore, an evaluation criterion applied to reports of diagnostic IT/DSSs for bioterrorism asked whether the reports described the systems' sensitivity and specificity. Of the 217 existing IT/DSSs that could be used to respond to bioterrorism, 79 studies evaluated 58 systems for at least 1 performance metric. Conclusions. The authors identified 8 key decisions that clinicians and public health officials must make in response to bioterrorism. When applying the evaluation system to 217 currently available IT/DSSs that could potentially support the decisions of clinicians and public health officials, the authors found that the literature provides little information about the accuracy of these systems.
AB - Objectives. The authors sought to develop a conceptual framework for evaluating whether existing information technologies and decision support systems (IT/DSSs) would assist the key decisions faced by clinicians and public health officials preparing for and responding to bioterrorism. Methods. They reviewed reports of natural and bioterrorism-related infectious outbreaks, bioterrorism preparedness exercises, and advice from experts to identify the key decisions, tasks, and information needs of clinicians and public health officials during a bioterrorism response. The authors used task decomposition to identify the subtasks and data requirements of IT/DSSs designed to facilitate a bioterrorism response. They used the results of the task decomposition to develop evaluation criteria for IT/DSSs for bioterrorism preparedness. They then applied these evaluation criteria to 341 reports of 217 existing lT/DSSs that could be used to support a bioterrorism response. Main Results. In response to bioterrorism, clinicians must make decisions in 4 critical domains (diagnosis, management, prevention, and reporting to public health), and public health officials must make decisions in 4 other domains (interpretation of bioterrorism surveillance data, outbreak investigation, outbreak control, and communication). The time horizons and utilityfunctions for these decisions differ. From the task decomposition, the authors identified critical subtasks for each of the 8 decisions. For example, interpretation of diagnostic tests is an important subtask of diagnostic decision making that requires an understanding of the tests' sensitivity and specificity. Therefore, an evaluation criterion applied to reports of diagnostic IT/DSSs for bioterrorism asked whether the reports described the systems' sensitivity and specificity. Of the 217 existing IT/DSSs that could be used to respond to bioterrorism, 79 studies evaluated 58 systems for at least 1 performance metric. Conclusions. The authors identified 8 key decisions that clinicians and public health officials must make in response to bioterrorism. When applying the evaluation system to 217 currently available IT/DSSs that could potentially support the decisions of clinicians and public health officials, the authors found that the literature provides little information about the accuracy of these systems.
KW - Bioterrorism
KW - Decision support techniques
KW - Expert system
KW - Information systems
KW - Public health
UR - http://www.scopus.com/inward/record.url?scp=1642380826&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=1642380826&partnerID=8YFLogxK
U2 - 10.1177/0272989X04263254
DO - 10.1177/0272989X04263254
M3 - Article
C2 - 15090105
AN - SCOPUS:1642380826
VL - 24
SP - 192
EP - 206
JO - Medical decision making : an international journal of the Society for Medical Decision Making
JF - Medical decision making : an international journal of the Society for Medical Decision Making
SN - 0272-989X
IS - 2
ER -