Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum

Mark R. Stefani, Bita Moghaddam

Research output: Contribution to journalArticle

99 Citations (Scopus)

Abstract

The midbrain dopamine system has been ascribed roles in reward expectancy, error detection, prediction, and memory. However, these theories typically do not differentiate between dopamine response and action in different forebrain terminal fields. We measured dopamine release in the prefrontal cortex (PFC), nucleus accumbens (NAc), and dorsal striatum (DS) of rats exposed to the same maze apparatus under three behavioral conditions: a set-shift task in which reward depended on discrimination learning and extradimensional set-shifting, a yoked condition in which reward was intermittent and not under the control of the subject, and a "reward-retrieval" variant in which reward was certain on every trial. We found dissociable patterns of dopamine release associated with learning, uncertainty, and reward. Dopamine increased in all three regions when reward was contingent on rule learning and shifting or was uncertain. These increases were sustained after behavior. There was a significant correlation between the magnitude of increase in PFC dopamine and the rapidity with which rats shifted between discrimination rules. In the yoke condition, in which the receipt of reward was always uncertain, the opposite relationship between dopamine levels and likelihood of reward was observed. Predictable, noncontingent reward was associated with increased dopamine levels in the NAc and DS. In contrast, PFC dopamine did not increase significantly above baseline levels. Thus, the dopaminergic projections to the PFC and nucleus accumbens were selectively, yet differentially, activated in situations of uncertainty and cognitive demand, whereas the dopaminergic projection to the DS responded independently of task differences in learning and reward.

Original languageEnglish (US)
Pages (from-to)8810-8818
Number of pages9
JournalJournal of Neuroscience
Volume26
Issue number34
DOIs
StatePublished - Aug 23 2006
Externally publishedYes

Fingerprint

Nucleus Accumbens
Prefrontal Cortex
Reward
Dopamine
Learning
Uncertainty
Discrimination Learning
Prosencephalon
Mesencephalon

Keywords

  • Addiction
  • Cognition
  • Discrimination learning
  • Goal-directed behavior
  • Schizophrenia
  • Set-shift

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

@article{5ad1b2d0e3a445a9bf93d84ac790e5f8,
title = "Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum",
abstract = "The midbrain dopamine system has been ascribed roles in reward expectancy, error detection, prediction, and memory. However, these theories typically do not differentiate between dopamine response and action in different forebrain terminal fields. We measured dopamine release in the prefrontal cortex (PFC), nucleus accumbens (NAc), and dorsal striatum (DS) of rats exposed to the same maze apparatus under three behavioral conditions: a set-shift task in which reward depended on discrimination learning and extradimensional set-shifting, a yoked condition in which reward was intermittent and not under the control of the subject, and a {"}reward-retrieval{"} variant in which reward was certain on every trial. We found dissociable patterns of dopamine release associated with learning, uncertainty, and reward. Dopamine increased in all three regions when reward was contingent on rule learning and shifting or was uncertain. These increases were sustained after behavior. There was a significant correlation between the magnitude of increase in PFC dopamine and the rapidity with which rats shifted between discrimination rules. In the yoke condition, in which the receipt of reward was always uncertain, the opposite relationship between dopamine levels and likelihood of reward was observed. Predictable, noncontingent reward was associated with increased dopamine levels in the NAc and DS. In contrast, PFC dopamine did not increase significantly above baseline levels. Thus, the dopaminergic projections to the PFC and nucleus accumbens were selectively, yet differentially, activated in situations of uncertainty and cognitive demand, whereas the dopaminergic projection to the DS responded independently of task differences in learning and reward.",
keywords = "Addiction, Cognition, Discrimination learning, Goal-directed behavior, Schizophrenia, Set-shift",
author = "Stefani, {Mark R.} and Bita Moghaddam",
year = "2006",
month = "8",
day = "23",
doi = "10.1523/JNEUROSCI.1656-06.2006",
language = "English (US)",
volume = "26",
pages = "8810--8818",
journal = "Journal of Neuroscience",
issn = "0270-6474",
publisher = "Society for Neuroscience",
number = "34",

}

TY - JOUR

T1 - Rule learning and reward contingency are associated with dissociable patterns of dopamine activation in the rat prefrontal cortex, nucleus accumbens, and dorsal striatum

AU - Stefani, Mark R.

AU - Moghaddam, Bita

PY - 2006/8/23

Y1 - 2006/8/23

N2 - The midbrain dopamine system has been ascribed roles in reward expectancy, error detection, prediction, and memory. However, these theories typically do not differentiate between dopamine response and action in different forebrain terminal fields. We measured dopamine release in the prefrontal cortex (PFC), nucleus accumbens (NAc), and dorsal striatum (DS) of rats exposed to the same maze apparatus under three behavioral conditions: a set-shift task in which reward depended on discrimination learning and extradimensional set-shifting, a yoked condition in which reward was intermittent and not under the control of the subject, and a "reward-retrieval" variant in which reward was certain on every trial. We found dissociable patterns of dopamine release associated with learning, uncertainty, and reward. Dopamine increased in all three regions when reward was contingent on rule learning and shifting or was uncertain. These increases were sustained after behavior. There was a significant correlation between the magnitude of increase in PFC dopamine and the rapidity with which rats shifted between discrimination rules. In the yoke condition, in which the receipt of reward was always uncertain, the opposite relationship between dopamine levels and likelihood of reward was observed. Predictable, noncontingent reward was associated with increased dopamine levels in the NAc and DS. In contrast, PFC dopamine did not increase significantly above baseline levels. Thus, the dopaminergic projections to the PFC and nucleus accumbens were selectively, yet differentially, activated in situations of uncertainty and cognitive demand, whereas the dopaminergic projection to the DS responded independently of task differences in learning and reward.

AB - The midbrain dopamine system has been ascribed roles in reward expectancy, error detection, prediction, and memory. However, these theories typically do not differentiate between dopamine response and action in different forebrain terminal fields. We measured dopamine release in the prefrontal cortex (PFC), nucleus accumbens (NAc), and dorsal striatum (DS) of rats exposed to the same maze apparatus under three behavioral conditions: a set-shift task in which reward depended on discrimination learning and extradimensional set-shifting, a yoked condition in which reward was intermittent and not under the control of the subject, and a "reward-retrieval" variant in which reward was certain on every trial. We found dissociable patterns of dopamine release associated with learning, uncertainty, and reward. Dopamine increased in all three regions when reward was contingent on rule learning and shifting or was uncertain. These increases were sustained after behavior. There was a significant correlation between the magnitude of increase in PFC dopamine and the rapidity with which rats shifted between discrimination rules. In the yoke condition, in which the receipt of reward was always uncertain, the opposite relationship between dopamine levels and likelihood of reward was observed. Predictable, noncontingent reward was associated with increased dopamine levels in the NAc and DS. In contrast, PFC dopamine did not increase significantly above baseline levels. Thus, the dopaminergic projections to the PFC and nucleus accumbens were selectively, yet differentially, activated in situations of uncertainty and cognitive demand, whereas the dopaminergic projection to the DS responded independently of task differences in learning and reward.

KW - Addiction

KW - Cognition

KW - Discrimination learning

KW - Goal-directed behavior

KW - Schizophrenia

KW - Set-shift

UR - http://www.scopus.com/inward/record.url?scp=33748251667&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33748251667&partnerID=8YFLogxK

U2 - 10.1523/JNEUROSCI.1656-06.2006

DO - 10.1523/JNEUROSCI.1656-06.2006

M3 - Article

C2 - 16928870

AN - SCOPUS:33748251667

VL - 26

SP - 8810

EP - 8818

JO - Journal of Neuroscience

JF - Journal of Neuroscience

SN - 0270-6474

IS - 34

ER -