The Unity and Diversity of Executive Functions: A Systematic Review and Re-Analysis of Latent Variable Studies

Justin E. Karr, Corson N. Areshenkoff, Philippe Rast, Scott Hofer, Grant L. Iverson, Mauricio A. Garcia-Barrera

Research output: Contribution to journalArticle

35 Citations (Scopus)

Abstract

Confirmatory factor analysis (CFA) has been frequently applied to executive function measurement since first used to identify a three-factor model of inhibition, updating, and shifting; however, subsequent CFAs have supported inconsistent models across the life span, ranging from unidimensional to nested-factor models (i.e., bifactor without inhibition). This systematic review summarized CFAs on performance-based tests of executive functions and reanalyzed summary data to identify best-fitting models. Eligible CFAs involved 46 samples (N = 9,756). The most frequently accepted models varied by age (i.e., preschool = one/two-factor; school-age = three-factor; adolescent/ adult = three/nested-factor; older adult = two/three-factor), and most often included updating/ working memory, inhibition, and shifting factors. A bootstrap reanalysis simulated 5,000 samples from 21 correlation matrices (11 child/adolescent; 10 adult) from studies including the three most common factors, fitting seven competing models. Model results were summarized as the mean percent accepted (i.e., average rate at which models converged and met fit thresholds: CFI = .90/RMSEA ≤ .08) and mean percent selected (i.e., average rate at which a model showed superior fit to other models: ΔCFI = ≥.005/.010/ΔRMSEA ≤ -.010/-.015). No model consistently converged and met fit criteria in all samples. Among adult samples, the nested-factor was accepted (41-42%) and selected (8 -30%) most often. Among child/adolescent samples, the unidimensional model was accepted (32-36%) and selected (21-53%) most often, with some support for two-factor models without a differentiated shifting factor. Results show some evidence for greater unidimensionality of executive function among child/adolescent samples and both unity and diversity among adult samples. However, low rates of model acceptance/selection suggest possible bias toward the publication of well-fitting but potentially nonreplicable models with underpowered samples.

Original languageEnglish (US)
JournalPsychological Bulletin
DOIs
StateAccepted/In press - Aug 6 2018

Fingerprint

Executive Function
Publication Bias
Age Factors
Short-Term Memory
Statistical Factor Analysis
Inhibition (Psychology)
chemotactic factor inactivator

Keywords

  • Cognitive control
  • Confirmatory factor analysis
  • Executive function
  • Latent variable analysis
  • Systematic review

ASJC Scopus subject areas

  • Psychology(all)

Cite this

The Unity and Diversity of Executive Functions : A Systematic Review and Re-Analysis of Latent Variable Studies. / Karr, Justin E.; Areshenkoff, Corson N.; Rast, Philippe; Hofer, Scott; Iverson, Grant L.; Garcia-Barrera, Mauricio A.

In: Psychological Bulletin, 06.08.2018.

Research output: Contribution to journalArticle

Karr, Justin E. ; Areshenkoff, Corson N. ; Rast, Philippe ; Hofer, Scott ; Iverson, Grant L. ; Garcia-Barrera, Mauricio A. / The Unity and Diversity of Executive Functions : A Systematic Review and Re-Analysis of Latent Variable Studies. In: Psychological Bulletin. 2018.
@article{67154af33bda4f60b05912fbee05e359,
title = "The Unity and Diversity of Executive Functions: A Systematic Review and Re-Analysis of Latent Variable Studies",
abstract = "Confirmatory factor analysis (CFA) has been frequently applied to executive function measurement since first used to identify a three-factor model of inhibition, updating, and shifting; however, subsequent CFAs have supported inconsistent models across the life span, ranging from unidimensional to nested-factor models (i.e., bifactor without inhibition). This systematic review summarized CFAs on performance-based tests of executive functions and reanalyzed summary data to identify best-fitting models. Eligible CFAs involved 46 samples (N = 9,756). The most frequently accepted models varied by age (i.e., preschool = one/two-factor; school-age = three-factor; adolescent/ adult = three/nested-factor; older adult = two/three-factor), and most often included updating/ working memory, inhibition, and shifting factors. A bootstrap reanalysis simulated 5,000 samples from 21 correlation matrices (11 child/adolescent; 10 adult) from studies including the three most common factors, fitting seven competing models. Model results were summarized as the mean percent accepted (i.e., average rate at which models converged and met fit thresholds: CFI = .90/RMSEA ≤ .08) and mean percent selected (i.e., average rate at which a model showed superior fit to other models: ΔCFI = ≥.005/.010/ΔRMSEA ≤ -.010/-.015). No model consistently converged and met fit criteria in all samples. Among adult samples, the nested-factor was accepted (41-42{\%}) and selected (8 -30{\%}) most often. Among child/adolescent samples, the unidimensional model was accepted (32-36{\%}) and selected (21-53{\%}) most often, with some support for two-factor models without a differentiated shifting factor. Results show some evidence for greater unidimensionality of executive function among child/adolescent samples and both unity and diversity among adult samples. However, low rates of model acceptance/selection suggest possible bias toward the publication of well-fitting but potentially nonreplicable models with underpowered samples.",
keywords = "Cognitive control, Confirmatory factor analysis, Executive function, Latent variable analysis, Systematic review",
author = "Karr, {Justin E.} and Areshenkoff, {Corson N.} and Philippe Rast and Scott Hofer and Iverson, {Grant L.} and Garcia-Barrera, {Mauricio A.}",
year = "2018",
month = "8",
day = "6",
doi = "10.1037/bul0000160",
language = "English (US)",
journal = "Psychological Bulletin",
issn = "0033-2909",
publisher = "American Psychological Association Inc.",

}

TY - JOUR

T1 - The Unity and Diversity of Executive Functions

T2 - A Systematic Review and Re-Analysis of Latent Variable Studies

AU - Karr, Justin E.

AU - Areshenkoff, Corson N.

AU - Rast, Philippe

AU - Hofer, Scott

AU - Iverson, Grant L.

AU - Garcia-Barrera, Mauricio A.

PY - 2018/8/6

Y1 - 2018/8/6

N2 - Confirmatory factor analysis (CFA) has been frequently applied to executive function measurement since first used to identify a three-factor model of inhibition, updating, and shifting; however, subsequent CFAs have supported inconsistent models across the life span, ranging from unidimensional to nested-factor models (i.e., bifactor without inhibition). This systematic review summarized CFAs on performance-based tests of executive functions and reanalyzed summary data to identify best-fitting models. Eligible CFAs involved 46 samples (N = 9,756). The most frequently accepted models varied by age (i.e., preschool = one/two-factor; school-age = three-factor; adolescent/ adult = three/nested-factor; older adult = two/three-factor), and most often included updating/ working memory, inhibition, and shifting factors. A bootstrap reanalysis simulated 5,000 samples from 21 correlation matrices (11 child/adolescent; 10 adult) from studies including the three most common factors, fitting seven competing models. Model results were summarized as the mean percent accepted (i.e., average rate at which models converged and met fit thresholds: CFI = .90/RMSEA ≤ .08) and mean percent selected (i.e., average rate at which a model showed superior fit to other models: ΔCFI = ≥.005/.010/ΔRMSEA ≤ -.010/-.015). No model consistently converged and met fit criteria in all samples. Among adult samples, the nested-factor was accepted (41-42%) and selected (8 -30%) most often. Among child/adolescent samples, the unidimensional model was accepted (32-36%) and selected (21-53%) most often, with some support for two-factor models without a differentiated shifting factor. Results show some evidence for greater unidimensionality of executive function among child/adolescent samples and both unity and diversity among adult samples. However, low rates of model acceptance/selection suggest possible bias toward the publication of well-fitting but potentially nonreplicable models with underpowered samples.

AB - Confirmatory factor analysis (CFA) has been frequently applied to executive function measurement since first used to identify a three-factor model of inhibition, updating, and shifting; however, subsequent CFAs have supported inconsistent models across the life span, ranging from unidimensional to nested-factor models (i.e., bifactor without inhibition). This systematic review summarized CFAs on performance-based tests of executive functions and reanalyzed summary data to identify best-fitting models. Eligible CFAs involved 46 samples (N = 9,756). The most frequently accepted models varied by age (i.e., preschool = one/two-factor; school-age = three-factor; adolescent/ adult = three/nested-factor; older adult = two/three-factor), and most often included updating/ working memory, inhibition, and shifting factors. A bootstrap reanalysis simulated 5,000 samples from 21 correlation matrices (11 child/adolescent; 10 adult) from studies including the three most common factors, fitting seven competing models. Model results were summarized as the mean percent accepted (i.e., average rate at which models converged and met fit thresholds: CFI = .90/RMSEA ≤ .08) and mean percent selected (i.e., average rate at which a model showed superior fit to other models: ΔCFI = ≥.005/.010/ΔRMSEA ≤ -.010/-.015). No model consistently converged and met fit criteria in all samples. Among adult samples, the nested-factor was accepted (41-42%) and selected (8 -30%) most often. Among child/adolescent samples, the unidimensional model was accepted (32-36%) and selected (21-53%) most often, with some support for two-factor models without a differentiated shifting factor. Results show some evidence for greater unidimensionality of executive function among child/adolescent samples and both unity and diversity among adult samples. However, low rates of model acceptance/selection suggest possible bias toward the publication of well-fitting but potentially nonreplicable models with underpowered samples.

KW - Cognitive control

KW - Confirmatory factor analysis

KW - Executive function

KW - Latent variable analysis

KW - Systematic review

UR - http://www.scopus.com/inward/record.url?scp=85051181461&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051181461&partnerID=8YFLogxK

U2 - 10.1037/bul0000160

DO - 10.1037/bul0000160

M3 - Article

C2 - 30080055

AN - SCOPUS:85051181461

JO - Psychological Bulletin

JF - Psychological Bulletin

SN - 0033-2909

ER -