The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals

Anthony I. Jang, Vincent Costa, Peter H. Rudebeck, Yogita Chudasama, Elisabeth A. Murray, Bruno B. Averbeck

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

Reversal learning has been extensively studied across species as a task that indexes the ability to flexibly make and reverse deterministic stimulus–reward associations. Although various brain lesions have been found to affect performance on this task, the behavioral processes affected by these lesions have not yet been determined. This task includes at least two kinds of learning. First, subjects have to learn and reverse stimulus–reward associations in each block of trials. Second, subjects becomemoreproficient at reversing choice preferences as they experience more reversals. We have developed a Bayesian approach to separately characterize these two learning processes. Reversal of choice behavior within each block is driven by a combination of evidence that a reversal has occurred, and a prior belief in reversals that evolves with experience across blocks. We applied the approach to behavior obtained from 89 macaques, comprising 12 lesion groups and a control group. We found that animals from all of the groups reversed more quickly as they experienced more reversals, and correspondingly they updated their prior beliefs about reversals at the same rate. However, the initial values of the priors that the various groups of animals brought to the task differed significantly, and it was these initial priors that led to the differences in behavior. Thus, by taking a Bayesian approach we find that variability in reversal-learning performance attributable to different neural systems is primarily driven by different prior beliefs about reversals that each group brings to the task.

Original languageEnglish (US)
Pages (from-to)11751-11760
Number of pages10
JournalJournal of Neuroscience
Volume35
Issue number33
DOIs
StatePublished - Aug 19 2015
Externally publishedYes

Fingerprint

Temporal Lobe
Reversal Learning
Bayes Theorem
Learning
Brain
Choice Behavior
Aptitude
Task Performance and Analysis
Macaca
Control Groups

Keywords

  • Amygdala
  • Bayesian prior
  • Learning set
  • Medial prefrontal cortex
  • Orbitofrontal cortex
  • Reversal learning

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals. / Jang, Anthony I.; Costa, Vincent; Rudebeck, Peter H.; Chudasama, Yogita; Murray, Elisabeth A.; Averbeck, Bruno B.

In: Journal of Neuroscience, Vol. 35, No. 33, 19.08.2015, p. 11751-11760.

Research output: Contribution to journalArticle

Jang, Anthony I. ; Costa, Vincent ; Rudebeck, Peter H. ; Chudasama, Yogita ; Murray, Elisabeth A. ; Averbeck, Bruno B. / The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals. In: Journal of Neuroscience. 2015 ; Vol. 35, No. 33. pp. 11751-11760.
@article{e59962aea95841808730b659ae0d5aaf,
title = "The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals",
abstract = "Reversal learning has been extensively studied across species as a task that indexes the ability to flexibly make and reverse deterministic stimulus–reward associations. Although various brain lesions have been found to affect performance on this task, the behavioral processes affected by these lesions have not yet been determined. This task includes at least two kinds of learning. First, subjects have to learn and reverse stimulus–reward associations in each block of trials. Second, subjects becomemoreproficient at reversing choice preferences as they experience more reversals. We have developed a Bayesian approach to separately characterize these two learning processes. Reversal of choice behavior within each block is driven by a combination of evidence that a reversal has occurred, and a prior belief in reversals that evolves with experience across blocks. We applied the approach to behavior obtained from 89 macaques, comprising 12 lesion groups and a control group. We found that animals from all of the groups reversed more quickly as they experienced more reversals, and correspondingly they updated their prior beliefs about reversals at the same rate. However, the initial values of the priors that the various groups of animals brought to the task differed significantly, and it was these initial priors that led to the differences in behavior. Thus, by taking a Bayesian approach we find that variability in reversal-learning performance attributable to different neural systems is primarily driven by different prior beliefs about reversals that each group brings to the task.",
keywords = "Amygdala, Bayesian prior, Learning set, Medial prefrontal cortex, Orbitofrontal cortex, Reversal learning",
author = "Jang, {Anthony I.} and Vincent Costa and Rudebeck, {Peter H.} and Yogita Chudasama and Murray, {Elisabeth A.} and Averbeck, {Bruno B.}",
year = "2015",
month = "8",
day = "19",
doi = "10.1523/JNEUROSCI.1594-15.2015",
language = "English (US)",
volume = "35",
pages = "11751--11760",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "33",

}

TY - JOUR

T1 - The role of frontal cortical and medial-temporal lobe brain areas in learning a Bayesian prior belief on reversals

AU - Jang, Anthony I.

AU - Costa, Vincent

AU - Rudebeck, Peter H.

AU - Chudasama, Yogita

AU - Murray, Elisabeth A.

AU - Averbeck, Bruno B.

PY - 2015/8/19

Y1 - 2015/8/19

N2 - Reversal learning has been extensively studied across species as a task that indexes the ability to flexibly make and reverse deterministic stimulus–reward associations. Although various brain lesions have been found to affect performance on this task, the behavioral processes affected by these lesions have not yet been determined. This task includes at least two kinds of learning. First, subjects have to learn and reverse stimulus–reward associations in each block of trials. Second, subjects becomemoreproficient at reversing choice preferences as they experience more reversals. We have developed a Bayesian approach to separately characterize these two learning processes. Reversal of choice behavior within each block is driven by a combination of evidence that a reversal has occurred, and a prior belief in reversals that evolves with experience across blocks. We applied the approach to behavior obtained from 89 macaques, comprising 12 lesion groups and a control group. We found that animals from all of the groups reversed more quickly as they experienced more reversals, and correspondingly they updated their prior beliefs about reversals at the same rate. However, the initial values of the priors that the various groups of animals brought to the task differed significantly, and it was these initial priors that led to the differences in behavior. Thus, by taking a Bayesian approach we find that variability in reversal-learning performance attributable to different neural systems is primarily driven by different prior beliefs about reversals that each group brings to the task.

AB - Reversal learning has been extensively studied across species as a task that indexes the ability to flexibly make and reverse deterministic stimulus–reward associations. Although various brain lesions have been found to affect performance on this task, the behavioral processes affected by these lesions have not yet been determined. This task includes at least two kinds of learning. First, subjects have to learn and reverse stimulus–reward associations in each block of trials. Second, subjects becomemoreproficient at reversing choice preferences as they experience more reversals. We have developed a Bayesian approach to separately characterize these two learning processes. Reversal of choice behavior within each block is driven by a combination of evidence that a reversal has occurred, and a prior belief in reversals that evolves with experience across blocks. We applied the approach to behavior obtained from 89 macaques, comprising 12 lesion groups and a control group. We found that animals from all of the groups reversed more quickly as they experienced more reversals, and correspondingly they updated their prior beliefs about reversals at the same rate. However, the initial values of the priors that the various groups of animals brought to the task differed significantly, and it was these initial priors that led to the differences in behavior. Thus, by taking a Bayesian approach we find that variability in reversal-learning performance attributable to different neural systems is primarily driven by different prior beliefs about reversals that each group brings to the task.

KW - Amygdala

KW - Bayesian prior

KW - Learning set

KW - Medial prefrontal cortex

KW - Orbitofrontal cortex

KW - Reversal learning

UR - http://www.scopus.com/inward/record.url?scp=84939817308&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84939817308&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.1594-15.2015

DO - 10.1523/JNEUROSCI.1594-15.2015

M3 - Article

C2 - 26290251

AN - SCOPUS:84939817308

VL - 35

SP - 11751

EP - 11760

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 33

ER -