Motivational neural circuits underlying reinforcement learning

Bruno B. Averbeck, Vincent Costa

Research output: Contribution to journalReview article

32 Citations (Scopus)

Abstract

Reinforcement learning (RL) is the behavioral process of learning the values of actions and objects. Most models of RL assume that the dopaminergic prediction error signal drives plasticity in frontal-striatal circuits. The striatum then encodes value representations that drive decision processes. However, the amygdala has also been shown to play an important role in forming Pavlovian stimulus-outcome associations. These Pavlovian associations can drive motivated behavior via the amygdala projections to the ventral striatum or the ventral tegmental area. The amygdala may, therefore, play a central role in RL. Here we compare the contributions of the amygdala and the striatum to RL and show that both the amygdala and striatum learn and represent expected values in RL tasks. Furthermore, value representations in the striatum may be inherited, to some extent, from the amygdala. The striatum may, therefore, play less of a primary role in learning stimulus-outcome associations in RL than previously suggested.

Original languageEnglish (US)
Pages (from-to)505-512
Number of pages8
JournalNature Neuroscience
Volume20
Issue number4
DOIs
StatePublished - Mar 29 2017
Externally publishedYes

Fingerprint

Amygdala
Learning
Corpus Striatum
Ventral Tegmental Area
Reinforcement (Psychology)
Drive

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Motivational neural circuits underlying reinforcement learning. / Averbeck, Bruno B.; Costa, Vincent.

In: Nature Neuroscience, Vol. 20, No. 4, 29.03.2017, p. 505-512.

Research output: Contribution to journalReview article

@article{32bd4db1e3d348e7a45724aa69c3a960,
title = "Motivational neural circuits underlying reinforcement learning",
abstract = "Reinforcement learning (RL) is the behavioral process of learning the values of actions and objects. Most models of RL assume that the dopaminergic prediction error signal drives plasticity in frontal-striatal circuits. The striatum then encodes value representations that drive decision processes. However, the amygdala has also been shown to play an important role in forming Pavlovian stimulus-outcome associations. These Pavlovian associations can drive motivated behavior via the amygdala projections to the ventral striatum or the ventral tegmental area. The amygdala may, therefore, play a central role in RL. Here we compare the contributions of the amygdala and the striatum to RL and show that both the amygdala and striatum learn and represent expected values in RL tasks. Furthermore, value representations in the striatum may be inherited, to some extent, from the amygdala. The striatum may, therefore, play less of a primary role in learning stimulus-outcome associations in RL than previously suggested.",
author = "Averbeck, {Bruno B.} and Vincent Costa",
year = "2017",
month = "3",
day = "29",
doi = "10.1038/nn.4506",
language = "English (US)",
volume = "20",
pages = "505--512",
journal = "Nature Neuroscience",
issn = "1097-6256",
publisher = "Nature Publishing Group",
number = "4",

}

TY - JOUR

T1 - Motivational neural circuits underlying reinforcement learning

AU - Averbeck, Bruno B.

AU - Costa, Vincent

PY - 2017/3/29

Y1 - 2017/3/29

N2 - Reinforcement learning (RL) is the behavioral process of learning the values of actions and objects. Most models of RL assume that the dopaminergic prediction error signal drives plasticity in frontal-striatal circuits. The striatum then encodes value representations that drive decision processes. However, the amygdala has also been shown to play an important role in forming Pavlovian stimulus-outcome associations. These Pavlovian associations can drive motivated behavior via the amygdala projections to the ventral striatum or the ventral tegmental area. The amygdala may, therefore, play a central role in RL. Here we compare the contributions of the amygdala and the striatum to RL and show that both the amygdala and striatum learn and represent expected values in RL tasks. Furthermore, value representations in the striatum may be inherited, to some extent, from the amygdala. The striatum may, therefore, play less of a primary role in learning stimulus-outcome associations in RL than previously suggested.

AB - Reinforcement learning (RL) is the behavioral process of learning the values of actions and objects. Most models of RL assume that the dopaminergic prediction error signal drives plasticity in frontal-striatal circuits. The striatum then encodes value representations that drive decision processes. However, the amygdala has also been shown to play an important role in forming Pavlovian stimulus-outcome associations. These Pavlovian associations can drive motivated behavior via the amygdala projections to the ventral striatum or the ventral tegmental area. The amygdala may, therefore, play a central role in RL. Here we compare the contributions of the amygdala and the striatum to RL and show that both the amygdala and striatum learn and represent expected values in RL tasks. Furthermore, value representations in the striatum may be inherited, to some extent, from the amygdala. The striatum may, therefore, play less of a primary role in learning stimulus-outcome associations in RL than previously suggested.

UR - http://www.scopus.com/inward/record.url?scp=85016760961&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85016760961&partnerID=8YFLogxK

U2 - 10.1038/nn.4506

DO - 10.1038/nn.4506

M3 - Review article

C2 - 28352111

AN - SCOPUS:85016760961

VL - 20

SP - 505

EP - 512

JO - Nature Neuroscience

JF - Nature Neuroscience

SN - 1097-6256

IS - 4

ER -