Dopamine modulates novelty seeking behavior during decision making

Vincent Costa, Valery L. Tran, Janita Turchi, Bruno B. Averbeck

Research output: Contribution to journalArticle

54 Citations (Scopus)

Abstract

Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake.

Original languageEnglish (US)
Pages (from-to)556-566
Number of pages11
JournalBehavioral Neuroscience
Volume128
Issue number5
DOIs
StatePublished - Jan 1 2014
Externally publishedYes

Fingerprint

Exploratory Behavior
Haplorhini
Dopamine
Decision Making
Dopamine Plasma Membrane Transport Proteins
Impulsive Behavior
Dopaminergic Neurons
Reward
Cues
Learning
Injections
Brain

Keywords

  • Curiosity
  • Dopamine
  • Exploitation
  • Exploration
  • Foraging
  • Impulsivity
  • Novelty seeking
  • Reinforcement learning
  • Reuptake
  • Uncertainty

ASJC Scopus subject areas

  • Behavioral Neuroscience

Cite this

Dopamine modulates novelty seeking behavior during decision making. / Costa, Vincent; Tran, Valery L.; Turchi, Janita; Averbeck, Bruno B.

In: Behavioral Neuroscience, Vol. 128, No. 5, 01.01.2014, p. 556-566.

Research output: Contribution to journalArticle

Costa, Vincent ; Tran, Valery L. ; Turchi, Janita ; Averbeck, Bruno B. / Dopamine modulates novelty seeking behavior during decision making. In: Behavioral Neuroscience. 2014 ; Vol. 128, No. 5. pp. 556-566.
@article{f6be4969e4864caa9aa114d2d534304f,
title = "Dopamine modulates novelty seeking behavior during decision making",
abstract = "Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake.",
keywords = "Curiosity, Dopamine, Exploitation, Exploration, Foraging, Impulsivity, Novelty seeking, Reinforcement learning, Reuptake, Uncertainty",
author = "Vincent Costa and Tran, {Valery L.} and Janita Turchi and Averbeck, {Bruno B.}",
year = "2014",
month = "1",
day = "1",
doi = "10.1037/a0037128",
language = "English (US)",
volume = "128",
pages = "556--566",
journal = "Behavioral Neuroscience",
issn = "0735-7044",
publisher = "American Psychological Association Inc.",
number = "5",

}

TY - JOUR

T1 - Dopamine modulates novelty seeking behavior during decision making

AU - Costa, Vincent

AU - Tran, Valery L.

AU - Turchi, Janita

AU - Averbeck, Bruno B.

PY - 2014/1/1

Y1 - 2014/1/1

N2 - Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake.

AB - Novelty seeking refers to the tendency of humans and animals to explore novel and unfamiliar stimuli and environments. The idea that dopamine modulates novelty seeking is supported by evidence that novel stimuli excite dopamine neurons and activate brain regions receiving dopaminergic input. In addition, dopamine is shown to drive exploratory behavior in novel environments. It is not clear whether dopamine promotes novelty seeking when it is framed as the decision to explore novel options versus the exploitation of familiar options. To test this hypothesis, we administered systemic injections of saline or GBR-12909, a selective dopamine transporter (DAT) inhibitor, to monkeys and assessed their novelty seeking behavior during a probabilistic decision making task. The task involved pseudorandom introductions of novel choice options. This allowed monkeys the opportunity to explore novel options or to exploit familiar options that they had already sampled. We found that DAT blockade increased the monkeys' preference for novel options. A reinforcement learning (RL) model fit to the monkeys' choice data showed that increased novelty seeking after DAT blockade was driven by an increase in the initial value the monkeys assigned to novel options. However, blocking DAT did not modulate the rate at which the monkeys learned which cues were most predictive of reward or their tendency to exploit that knowledge. These data demonstrate that dopamine enhances novelty-driven value and imply that excessive novelty seeking-characteristic of impulsivity and behavioral addictions-might be caused by increases in dopamine, stemming from less reuptake.

KW - Curiosity

KW - Dopamine

KW - Exploitation

KW - Exploration

KW - Foraging

KW - Impulsivity

KW - Novelty seeking

KW - Reinforcement learning

KW - Reuptake

KW - Uncertainty

UR - http://www.scopus.com/inward/record.url?scp=84925742234&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84925742234&partnerID=8YFLogxK

U2 - 10.1037/a0037128

DO - 10.1037/a0037128

M3 - Article

VL - 128

SP - 556

EP - 566

JO - Behavioral Neuroscience

JF - Behavioral Neuroscience

SN - 0735-7044

IS - 5

ER -