Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning

Vincent Costa, Olga Dal Monte, Daniel R. Lucas, Elisabeth A. Murray, Bruno B. Averbeck

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys’ choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL.

Original languageEnglish (US)
Pages (from-to)505-517
Number of pages13
JournalNeuron
Volume92
Issue number2
DOIs
StatePublished - Oct 19 2016
Externally publishedYes

Fingerprint

Amygdala
Learning
Reversal Learning
Choice Behavior
Reinforcement (Psychology)
Ventral Striatum
Macaca mulatta
Reaction Time
Haplorhini

Keywords

  • amygdala
  • associability
  • Bayesian
  • decision making
  • lesion
  • Pearce-Hall
  • reinforcement learning
  • Rescorla-Wagner
  • speed-accuracy trade-off
  • ventral striatum

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning. / Costa, Vincent; Dal Monte, Olga; Lucas, Daniel R.; Murray, Elisabeth A.; Averbeck, Bruno B.

In: Neuron, Vol. 92, No. 2, 19.10.2016, p. 505-517.

Research output: Contribution to journalArticle

Costa, V, Dal Monte, O, Lucas, DR, Murray, EA & Averbeck, BB 2016, 'Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning', Neuron, vol. 92, no. 2, pp. 505-517. https://doi.org/10.1016/j.neuron.2016.09.025
Costa, Vincent ; Dal Monte, Olga ; Lucas, Daniel R. ; Murray, Elisabeth A. ; Averbeck, Bruno B. / Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning. In: Neuron. 2016 ; Vol. 92, No. 2. pp. 505-517.
@article{86e92936cb794e81a9d04a593eca920c,
title = "Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning",
abstract = "Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys’ choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL.",
keywords = "amygdala, associability, Bayesian, decision making, lesion, Pearce-Hall, reinforcement learning, Rescorla-Wagner, speed-accuracy trade-off, ventral striatum",
author = "Vincent Costa and {Dal Monte}, Olga and Lucas, {Daniel R.} and Murray, {Elisabeth A.} and Averbeck, {Bruno B.}",
year = "2016",
month = "10",
day = "19",
doi = "10.1016/j.neuron.2016.09.025",
language = "English (US)",
volume = "92",
pages = "505--517",
journal = "Neuron",
issn = "0896-6273",
publisher = "Cell Press",
number = "2",

}

TY - JOUR

T1 - Amygdala and Ventral Striatum Make Distinct Contributions to Reinforcement Learning

AU - Costa, Vincent

AU - Dal Monte, Olga

AU - Lucas, Daniel R.

AU - Murray, Elisabeth A.

AU - Averbeck, Bruno B.

PY - 2016/10/19

Y1 - 2016/10/19

N2 - Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys’ choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL.

AB - Reinforcement learning (RL) theories posit that dopaminergic signals are integrated within the striatum to associate choices with outcomes. Often overlooked is that the amygdala also receives dopaminergic input and is involved in Pavlovian processes that influence choice behavior. To determine the relative contributions of the ventral striatum (VS) and amygdala to appetitive RL, we tested rhesus macaques with VS or amygdala lesions on deterministic and stochastic versions of a two-arm bandit reversal learning task. When learning was characterized with an RL model relative to controls, amygdala lesions caused general decreases in learning from positive feedback and choice consistency. By comparison, VS lesions only affected learning in the stochastic task. Moreover, the VS lesions hastened the monkeys’ choice reaction times, which emphasized a speed-accuracy trade-off that accounted for errors in deterministic learning. These results update standard accounts of RL by emphasizing distinct contributions of the amygdala and VS to RL.

KW - amygdala

KW - associability

KW - Bayesian

KW - decision making

KW - lesion

KW - Pearce-Hall

KW - reinforcement learning

KW - Rescorla-Wagner

KW - speed-accuracy trade-off

KW - ventral striatum

UR - http://www.scopus.com/inward/record.url?scp=84992109627&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84992109627&partnerID=8YFLogxK

U2 - 10.1016/j.neuron.2016.09.025

DO - 10.1016/j.neuron.2016.09.025

M3 - Article

VL - 92

SP - 505

EP - 517

JO - Neuron

JF - Neuron

SN - 0896-6273

IS - 2

ER -