Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning

Kathryn M. Rothenhoefe, Vincent Costa, Ramón Bartolo, Raquel Vicario-Feliciano, Elisabeth A. Murray, Bruno B. Averbeck

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups’ learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions.

Original languageEnglish (US)
Pages (from-to)6902-6914
Number of pages13
JournalJournal of Neuroscience
Volume37
Issue number29
DOIs
StatePublished - Jul 19 2017
Externally publishedYes

Fingerprint

Learning
Haplorhini
Reinforcement (Psychology)
Ventral Striatum
Macaca mulatta

Keywords

  • Reinforcement learning
  • Ventral striatum

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Rothenhoefe, K. M., Costa, V., Bartolo, R., Vicario-Feliciano, R., Murray, E. A., & Averbeck, B. B. (2017). Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning. Journal of Neuroscience, 37(29), 6902-6914. https://doi.org/10.1523/JNEUROSCI.0631-17.2017

Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning. / Rothenhoefe, Kathryn M.; Costa, Vincent; Bartolo, Ramón; Vicario-Feliciano, Raquel; Murray, Elisabeth A.; Averbeck, Bruno B.

In: Journal of Neuroscience, Vol. 37, No. 29, 19.07.2017, p. 6902-6914.

Research output: Contribution to journalArticle

Rothenhoefe, KM, Costa, V, Bartolo, R, Vicario-Feliciano, R, Murray, EA & Averbeck, BB 2017, 'Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning', Journal of Neuroscience, vol. 37, no. 29, pp. 6902-6914. https://doi.org/10.1523/JNEUROSCI.0631-17.2017
Rothenhoefe, Kathryn M. ; Costa, Vincent ; Bartolo, Ramón ; Vicario-Feliciano, Raquel ; Murray, Elisabeth A. ; Averbeck, Bruno B. / Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning. In: Journal of Neuroscience. 2017 ; Vol. 37, No. 29. pp. 6902-6914.
@article{5e05c23e7e8e43538fa01ed34e855a05,
title = "Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning",
abstract = "Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups’ learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions.",
keywords = "Reinforcement learning, Ventral striatum",
author = "Rothenhoefe, {Kathryn M.} and Vincent Costa and Ram{\'o}n Bartolo and Raquel Vicario-Feliciano and Murray, {Elisabeth A.} and Averbeck, {Bruno B.}",
year = "2017",
month = "7",
day = "19",
doi = "10.1523/JNEUROSCI.0631-17.2017",
language = "English (US)",
volume = "37",
pages = "6902--6914",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "29",

}

TY - JOUR

T1 - Effects of ventral striatum lesions on stimulus-based versus action-based reinforcement learning

AU - Rothenhoefe, Kathryn M.

AU - Costa, Vincent

AU - Bartolo, Ramón

AU - Vicario-Feliciano, Raquel

AU - Murray, Elisabeth A.

AU - Averbeck, Bruno B.

PY - 2017/7/19

Y1 - 2017/7/19

N2 - Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups’ learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions.

AB - Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups’ learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions.

KW - Reinforcement learning

KW - Ventral striatum

UR - http://www.scopus.com/inward/record.url?scp=85025120313&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85025120313&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.0631-17.2017

DO - 10.1523/JNEUROSCI.0631-17.2017

M3 - Article

C2 - 28626011

AN - SCOPUS:85025120313

VL - 37

SP - 6902

EP - 6914

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 29

ER -