Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported

Lauren E. Griffith, Edwin Van Den Heuvel, Isabel Fortier, Nazmul Sohel, Scott Hofer, Hélène Payette, Christina Wolfson, Sylvie Belleville, Meghan Kenny, Dany Doiron, Parminder Raina

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Objectives To identify statistical methods for harmonization, the procedures aimed at achieving the comparability of previously collected data, which could be used in the context of summary data and individual participant data meta-Analysis of cognitive measures. Study Design and Setting Environmental scan methods were used to conduct two reviews to identify (1) studies that quantitatively combined data on cognition and (2) general literature on statistical methods for data harmonization. Search results were rapidly screened to identify articles of relevance. Results All 33 meta-Analyses combining cognition measures either restricted their analyses to a subset of studies using a common measure or combined standardized effect sizes across studies; none reported their harmonization steps before producing summary effects. In the second scan, three general classes of statistical harmonization models were identified (1) standardization methods, (2) latent variable models, and (3) multiple imputation models; few publications compared methods. Conclusion Although it is an implicit part of conducting a meta-Analysis or pooled analysis, the methods used to assess inferential equivalence of complex constructs are rarely reported or discussed. Progress in this area will be supported by guidelines for the conduct and reporting of the data harmonization and integration and by evaluating and developing statistical approaches to harmonization.

Original languageEnglish (US)
Pages (from-to)154-162
Number of pages9
JournalJournal of Clinical Epidemiology
Volume68
Issue number2
DOIs
StatePublished - Feb 1 2015
Externally publishedYes

Fingerprint

Meta-Analysis
Cognition
Statistical Models
Publications
Research Design
Guidelines

Keywords

  • Cognition
  • Combination
  • Data pooling
  • Harmonization
  • Individual participant data
  • Meta-Analysis
  • Transformation

ASJC Scopus subject areas

  • Epidemiology
  • Medicine(all)

Cite this

Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported. / Griffith, Lauren E.; Van Den Heuvel, Edwin; Fortier, Isabel; Sohel, Nazmul; Hofer, Scott; Payette, Hélène; Wolfson, Christina; Belleville, Sylvie; Kenny, Meghan; Doiron, Dany; Raina, Parminder.

In: Journal of Clinical Epidemiology, Vol. 68, No. 2, 01.02.2015, p. 154-162.

Research output: Contribution to journalArticle

Griffith, LE, Van Den Heuvel, E, Fortier, I, Sohel, N, Hofer, S, Payette, H, Wolfson, C, Belleville, S, Kenny, M, Doiron, D & Raina, P 2015, 'Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported', Journal of Clinical Epidemiology, vol. 68, no. 2, pp. 154-162. https://doi.org/10.1016/j.jclinepi.2014.09.003
Griffith, Lauren E. ; Van Den Heuvel, Edwin ; Fortier, Isabel ; Sohel, Nazmul ; Hofer, Scott ; Payette, Hélène ; Wolfson, Christina ; Belleville, Sylvie ; Kenny, Meghan ; Doiron, Dany ; Raina, Parminder. / Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported. In: Journal of Clinical Epidemiology. 2015 ; Vol. 68, No. 2. pp. 154-162.
@article{b5d97e988e8143a89b0e6749ce6d6f20,
title = "Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported",
abstract = "Objectives To identify statistical methods for harmonization, the procedures aimed at achieving the comparability of previously collected data, which could be used in the context of summary data and individual participant data meta-Analysis of cognitive measures. Study Design and Setting Environmental scan methods were used to conduct two reviews to identify (1) studies that quantitatively combined data on cognition and (2) general literature on statistical methods for data harmonization. Search results were rapidly screened to identify articles of relevance. Results All 33 meta-Analyses combining cognition measures either restricted their analyses to a subset of studies using a common measure or combined standardized effect sizes across studies; none reported their harmonization steps before producing summary effects. In the second scan, three general classes of statistical harmonization models were identified (1) standardization methods, (2) latent variable models, and (3) multiple imputation models; few publications compared methods. Conclusion Although it is an implicit part of conducting a meta-Analysis or pooled analysis, the methods used to assess inferential equivalence of complex constructs are rarely reported or discussed. Progress in this area will be supported by guidelines for the conduct and reporting of the data harmonization and integration and by evaluating and developing statistical approaches to harmonization.",
keywords = "Cognition, Combination, Data pooling, Harmonization, Individual participant data, Meta-Analysis, Transformation",
author = "Griffith, {Lauren E.} and {Van Den Heuvel}, Edwin and Isabel Fortier and Nazmul Sohel and Scott Hofer and H{\'e}l{\`e}ne Payette and Christina Wolfson and Sylvie Belleville and Meghan Kenny and Dany Doiron and Parminder Raina",
year = "2015",
month = "2",
day = "1",
doi = "10.1016/j.jclinepi.2014.09.003",
language = "English (US)",
volume = "68",
pages = "154--162",
journal = "Journal of Clinical Epidemiology",
issn = "0895-4356",
publisher = "Elsevier USA",
number = "2",

}

TY - JOUR

T1 - Statistical approaches to harmonize data on cognitive measures in systematic reviews are rarely reported

AU - Griffith, Lauren E.

AU - Van Den Heuvel, Edwin

AU - Fortier, Isabel

AU - Sohel, Nazmul

AU - Hofer, Scott

AU - Payette, Hélène

AU - Wolfson, Christina

AU - Belleville, Sylvie

AU - Kenny, Meghan

AU - Doiron, Dany

AU - Raina, Parminder

PY - 2015/2/1

Y1 - 2015/2/1

N2 - Objectives To identify statistical methods for harmonization, the procedures aimed at achieving the comparability of previously collected data, which could be used in the context of summary data and individual participant data meta-Analysis of cognitive measures. Study Design and Setting Environmental scan methods were used to conduct two reviews to identify (1) studies that quantitatively combined data on cognition and (2) general literature on statistical methods for data harmonization. Search results were rapidly screened to identify articles of relevance. Results All 33 meta-Analyses combining cognition measures either restricted their analyses to a subset of studies using a common measure or combined standardized effect sizes across studies; none reported their harmonization steps before producing summary effects. In the second scan, three general classes of statistical harmonization models were identified (1) standardization methods, (2) latent variable models, and (3) multiple imputation models; few publications compared methods. Conclusion Although it is an implicit part of conducting a meta-Analysis or pooled analysis, the methods used to assess inferential equivalence of complex constructs are rarely reported or discussed. Progress in this area will be supported by guidelines for the conduct and reporting of the data harmonization and integration and by evaluating and developing statistical approaches to harmonization.

AB - Objectives To identify statistical methods for harmonization, the procedures aimed at achieving the comparability of previously collected data, which could be used in the context of summary data and individual participant data meta-Analysis of cognitive measures. Study Design and Setting Environmental scan methods were used to conduct two reviews to identify (1) studies that quantitatively combined data on cognition and (2) general literature on statistical methods for data harmonization. Search results were rapidly screened to identify articles of relevance. Results All 33 meta-Analyses combining cognition measures either restricted their analyses to a subset of studies using a common measure or combined standardized effect sizes across studies; none reported their harmonization steps before producing summary effects. In the second scan, three general classes of statistical harmonization models were identified (1) standardization methods, (2) latent variable models, and (3) multiple imputation models; few publications compared methods. Conclusion Although it is an implicit part of conducting a meta-Analysis or pooled analysis, the methods used to assess inferential equivalence of complex constructs are rarely reported or discussed. Progress in this area will be supported by guidelines for the conduct and reporting of the data harmonization and integration and by evaluating and developing statistical approaches to harmonization.

KW - Cognition

KW - Combination

KW - Data pooling

KW - Harmonization

KW - Individual participant data

KW - Meta-Analysis

KW - Transformation

UR - http://www.scopus.com/inward/record.url?scp=84920598483&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84920598483&partnerID=8YFLogxK

U2 - 10.1016/j.jclinepi.2014.09.003

DO - 10.1016/j.jclinepi.2014.09.003

M3 - Article

C2 - 25497980

AN - SCOPUS:84920598483

VL - 68

SP - 154

EP - 162

JO - Journal of Clinical Epidemiology

JF - Journal of Clinical Epidemiology

SN - 0895-4356

IS - 2

ER -