Ventral striatum’s role in learning from gains and losses

Craig A. Taswell, Vincent D. Costa, Elisabeth A. Murray, Bruno B. Averbeck

Research output: Contribution to journalArticlepeer-review

20 Scopus citations

Abstract

Adaptive behavior requires animals to learn from experience. Ideally, learning should both promote choices that lead to rewards and reduce choices that lead to losses. Because the ventral striatum (VS) contains neurons that respond to aversive stimuli and aversive stimuli can drive dopamine release in the VS, it is possible that the VS contributes to learning about aversive outcomes, including losses. However, other work suggests that the VS may play a specific role in learning to choose among rewards, with other systems mediating learning from aversive outcomes. To examine the role of the VS in learning from gains and losses, we compared the performance of macaque monkeys with VS lesions and unoperated controls on a reinforcement learning task. In the task, the monkeys gained or lost tokens, which were periodically cashed out for juice, as outcomes for choices. They learned over trials to choose cues associated with gains, and not choose cues associated with losses. We found that monkeys with VS lesions had a deficit in learning to choose between cues that differed in reward magnitude. By contrast, monkeys with VS lesions performed as well as controls when choices involved a potential loss. We also fit reinforcement learning models to the behavior and compared learning rates between groups. Relative to controls, the monkeys with VS lesions had reduced learning rates for gain cues. Therefore, in this task, the VS plays a specific role in learning to choose between rewarding options.

Original languageEnglish (US)
Pages (from-to)E12398-E12406
JournalProceedings of the National Academy of Sciences of the United States of America
Volume115
Issue number52
DOIs
StatePublished - Dec 26 2018
Externally publishedYes

Keywords

  • Appetitive
  • Aversive
  • Neuroeconomics
  • Reinforcement learning
  • Ventral striatum

ASJC Scopus subject areas

  • General

Fingerprint

Dive into the research topics of 'Ventral striatum’s role in learning from gains and losses'. Together they form a unique fingerprint.

Cite this