Status of computerized cognitive testing in aging: A systematic review

Katherine Wild, Diane Howieson, Frank Webbe, Adriana Seelye, Jeffrey Kaye

Research output: Contribution to journalArticle

216 Citations (Scopus)

Abstract

Background: Early detection of cognitive decline in the elderly has become of heightened importance in parallel with the recent advances in therapeutics. Computerized assessment might be uniquely suited to early detection of changes in cognition in the elderly. We present here a systematic review of the status of computer-based cognitive testing, focusing on detection of cognitive decline in the aging population. Methods: All studies purporting to assess or detect age-related changes in cognition or early dementia/mild cognitive impairment by means of computerized testing were included. Each test battery was rated on availability of normative data, level of evidence for test validity and reliability, comprehensiveness, and usability. All published studies relevant to a particular computerized test were read by a minimum of two reviewers, who completed rating forms containing the abovementioned criteria. Results: Of the 18 test batteries identified from the initial search, 11 were appropriate to cognitive testing in the elderly and were subjected to systematic review. Of those 11, five were either developed specifically for application with the elderly or have been used extensively with that population. Even within the computerized testing genre, great variability existed in manner of administration, ranging from fully examiner-administered to fully self-administered. All tests had at least minimal reliability and validity data, commonly reported in peer-reviewed articles. However, level of rigor of validity testing varied widely. Conclusion: All test batteries exhibited some of the strengths of computerized cognitive testing: standardization of administration and stimulus presentation, accurate measures of response latencies, automated comparison in real time with an individual's prior performance as well as with age-related norms, and efficiencies of staffing and cost. Some, such as the Mild Cognitive Impairment Screen, adapted complicated scoring algorithms to enhance the information gathered from already existing tests. Others, such as CogState, used unique interfaces and subtests. We found that although basic indices of psychometric properties were typically addressed, sufficient variability exists that currently available computerized test batteries must be judged on a case-by-case basis.

Original languageEnglish (US)
Pages (from-to)428-437
Number of pages10
JournalAlzheimer's and Dementia
Volume4
Issue number6
DOIs
StatePublished - Nov 2008

Fingerprint

Reproducibility of Results
Cognition
Psychometrics
Population
Reaction Time
Dementia
Costs and Cost Analysis
Cognitive Dysfunction
Therapeutics

Keywords

  • Computerized cognitive assessment
  • Computerized testing
  • Dementia
  • Early detection
  • Psychometrics
  • Systematic review

ASJC Scopus subject areas

  • Health Policy
  • Epidemiology
  • Geriatrics and Gerontology
  • Psychiatry and Mental health
  • Cellular and Molecular Neuroscience
  • Developmental Neuroscience
  • Clinical Neurology

Cite this

Status of computerized cognitive testing in aging : A systematic review. / Wild, Katherine; Howieson, Diane; Webbe, Frank; Seelye, Adriana; Kaye, Jeffrey.

In: Alzheimer's and Dementia, Vol. 4, No. 6, 11.2008, p. 428-437.

Research output: Contribution to journalArticle

Wild, Katherine ; Howieson, Diane ; Webbe, Frank ; Seelye, Adriana ; Kaye, Jeffrey. / Status of computerized cognitive testing in aging : A systematic review. In: Alzheimer's and Dementia. 2008 ; Vol. 4, No. 6. pp. 428-437.
@article{2977318c954d4a42a9b85e3a9dae2e43,
title = "Status of computerized cognitive testing in aging: A systematic review",
abstract = "Background: Early detection of cognitive decline in the elderly has become of heightened importance in parallel with the recent advances in therapeutics. Computerized assessment might be uniquely suited to early detection of changes in cognition in the elderly. We present here a systematic review of the status of computer-based cognitive testing, focusing on detection of cognitive decline in the aging population. Methods: All studies purporting to assess or detect age-related changes in cognition or early dementia/mild cognitive impairment by means of computerized testing were included. Each test battery was rated on availability of normative data, level of evidence for test validity and reliability, comprehensiveness, and usability. All published studies relevant to a particular computerized test were read by a minimum of two reviewers, who completed rating forms containing the abovementioned criteria. Results: Of the 18 test batteries identified from the initial search, 11 were appropriate to cognitive testing in the elderly and were subjected to systematic review. Of those 11, five were either developed specifically for application with the elderly or have been used extensively with that population. Even within the computerized testing genre, great variability existed in manner of administration, ranging from fully examiner-administered to fully self-administered. All tests had at least minimal reliability and validity data, commonly reported in peer-reviewed articles. However, level of rigor of validity testing varied widely. Conclusion: All test batteries exhibited some of the strengths of computerized cognitive testing: standardization of administration and stimulus presentation, accurate measures of response latencies, automated comparison in real time with an individual's prior performance as well as with age-related norms, and efficiencies of staffing and cost. Some, such as the Mild Cognitive Impairment Screen, adapted complicated scoring algorithms to enhance the information gathered from already existing tests. Others, such as CogState, used unique interfaces and subtests. We found that although basic indices of psychometric properties were typically addressed, sufficient variability exists that currently available computerized test batteries must be judged on a case-by-case basis.",
keywords = "Computerized cognitive assessment, Computerized testing, Dementia, Early detection, Psychometrics, Systematic review",
author = "Katherine Wild and Diane Howieson and Frank Webbe and Adriana Seelye and Jeffrey Kaye",
year = "2008",
month = "11",
doi = "10.1016/j.jalz.2008.07.003",
language = "English (US)",
volume = "4",
pages = "428--437",
journal = "Alzheimer's and Dementia",
issn = "1552-5260",
publisher = "Elsevier Inc.",
number = "6",

}

TY - JOUR

T1 - Status of computerized cognitive testing in aging

T2 - A systematic review

AU - Wild, Katherine

AU - Howieson, Diane

AU - Webbe, Frank

AU - Seelye, Adriana

AU - Kaye, Jeffrey

PY - 2008/11

Y1 - 2008/11

N2 - Background: Early detection of cognitive decline in the elderly has become of heightened importance in parallel with the recent advances in therapeutics. Computerized assessment might be uniquely suited to early detection of changes in cognition in the elderly. We present here a systematic review of the status of computer-based cognitive testing, focusing on detection of cognitive decline in the aging population. Methods: All studies purporting to assess or detect age-related changes in cognition or early dementia/mild cognitive impairment by means of computerized testing were included. Each test battery was rated on availability of normative data, level of evidence for test validity and reliability, comprehensiveness, and usability. All published studies relevant to a particular computerized test were read by a minimum of two reviewers, who completed rating forms containing the abovementioned criteria. Results: Of the 18 test batteries identified from the initial search, 11 were appropriate to cognitive testing in the elderly and were subjected to systematic review. Of those 11, five were either developed specifically for application with the elderly or have been used extensively with that population. Even within the computerized testing genre, great variability existed in manner of administration, ranging from fully examiner-administered to fully self-administered. All tests had at least minimal reliability and validity data, commonly reported in peer-reviewed articles. However, level of rigor of validity testing varied widely. Conclusion: All test batteries exhibited some of the strengths of computerized cognitive testing: standardization of administration and stimulus presentation, accurate measures of response latencies, automated comparison in real time with an individual's prior performance as well as with age-related norms, and efficiencies of staffing and cost. Some, such as the Mild Cognitive Impairment Screen, adapted complicated scoring algorithms to enhance the information gathered from already existing tests. Others, such as CogState, used unique interfaces and subtests. We found that although basic indices of psychometric properties were typically addressed, sufficient variability exists that currently available computerized test batteries must be judged on a case-by-case basis.

AB - Background: Early detection of cognitive decline in the elderly has become of heightened importance in parallel with the recent advances in therapeutics. Computerized assessment might be uniquely suited to early detection of changes in cognition in the elderly. We present here a systematic review of the status of computer-based cognitive testing, focusing on detection of cognitive decline in the aging population. Methods: All studies purporting to assess or detect age-related changes in cognition or early dementia/mild cognitive impairment by means of computerized testing were included. Each test battery was rated on availability of normative data, level of evidence for test validity and reliability, comprehensiveness, and usability. All published studies relevant to a particular computerized test were read by a minimum of two reviewers, who completed rating forms containing the abovementioned criteria. Results: Of the 18 test batteries identified from the initial search, 11 were appropriate to cognitive testing in the elderly and were subjected to systematic review. Of those 11, five were either developed specifically for application with the elderly or have been used extensively with that population. Even within the computerized testing genre, great variability existed in manner of administration, ranging from fully examiner-administered to fully self-administered. All tests had at least minimal reliability and validity data, commonly reported in peer-reviewed articles. However, level of rigor of validity testing varied widely. Conclusion: All test batteries exhibited some of the strengths of computerized cognitive testing: standardization of administration and stimulus presentation, accurate measures of response latencies, automated comparison in real time with an individual's prior performance as well as with age-related norms, and efficiencies of staffing and cost. Some, such as the Mild Cognitive Impairment Screen, adapted complicated scoring algorithms to enhance the information gathered from already existing tests. Others, such as CogState, used unique interfaces and subtests. We found that although basic indices of psychometric properties were typically addressed, sufficient variability exists that currently available computerized test batteries must be judged on a case-by-case basis.

KW - Computerized cognitive assessment

KW - Computerized testing

KW - Dementia

KW - Early detection

KW - Psychometrics

KW - Systematic review

UR - http://www.scopus.com/inward/record.url?scp=55549132657&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=55549132657&partnerID=8YFLogxK

U2 - 10.1016/j.jalz.2008.07.003

DO - 10.1016/j.jalz.2008.07.003

M3 - Article

C2 - 19012868

AN - SCOPUS:55549132657

VL - 4

SP - 428

EP - 437

JO - Alzheimer's and Dementia

JF - Alzheimer's and Dementia

SN - 1552-5260

IS - 6

ER -