Networks of VTA neurons encode real-time information about uncertain numbers of actions executed to earn a reward

Jesse Wood, Nicholas W. Simon, F. Spencer Koerner, Robert E. Kass, Bita Moghaddam

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.

Original languageEnglish (US)
Article number140
JournalFrontiers in Behavioral Neuroscience
Volume11
DOIs
StatePublished - Aug 8 2017

Fingerprint

Ventral Tegmental Area
Reward
Neurons
Cues
Dopamine
Dopaminergic Neurons
Mesencephalon
Basal Ganglia
Prefrontal Cortex
Automatic Data Processing
Cognition
Noise
Population

Keywords

  • Action sequence
  • Assemblies
  • Dopamine
  • Ensemble coding
  • Instrumental conditioning
  • Serial actions
  • Ventral tegmental area
  • VTA

ASJC Scopus subject areas

  • Neuropsychology and Physiological Psychology
  • Cognitive Neuroscience
  • Behavioral Neuroscience

Cite this

Networks of VTA neurons encode real-time information about uncertain numbers of actions executed to earn a reward. / Wood, Jesse; Simon, Nicholas W.; Koerner, F. Spencer; Kass, Robert E.; Moghaddam, Bita.

In: Frontiers in Behavioral Neuroscience, Vol. 11, 140, 08.08.2017.

Research output: Contribution to journalArticle

@article{8ef007e0e06d4de2ac72a797ad60e213,
title = "Networks of VTA neurons encode real-time information about uncertain numbers of actions executed to earn a reward",
abstract = "Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.",
keywords = "Action sequence, Assemblies, Dopamine, Ensemble coding, Instrumental conditioning, Serial actions, Ventral tegmental area, VTA",
author = "Jesse Wood and Simon, {Nicholas W.} and Koerner, {F. Spencer} and Kass, {Robert E.} and Bita Moghaddam",
year = "2017",
month = "8",
day = "8",
doi = "10.3389/fnbeh.2017.00140",
language = "English (US)",
volume = "11",
journal = "Frontiers in Behavioral Neuroscience",
issn = "1662-5153",
publisher = "Frontiers Research Foundation",

}

TY - JOUR

T1 - Networks of VTA neurons encode real-time information about uncertain numbers of actions executed to earn a reward

AU - Wood, Jesse

AU - Simon, Nicholas W.

AU - Koerner, F. Spencer

AU - Kass, Robert E.

AU - Moghaddam, Bita

PY - 2017/8/8

Y1 - 2017/8/8

N2 - Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.

AB - Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.

KW - Action sequence

KW - Assemblies

KW - Dopamine

KW - Ensemble coding

KW - Instrumental conditioning

KW - Serial actions

KW - Ventral tegmental area

KW - VTA

UR - http://www.scopus.com/inward/record.url?scp=85027888833&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85027888833&partnerID=8YFLogxK

U2 - 10.3389/fnbeh.2017.00140

DO - 10.3389/fnbeh.2017.00140

M3 - Article

AN - SCOPUS:85027888833

VL - 11

JO - Frontiers in Behavioral Neuroscience

JF - Frontiers in Behavioral Neuroscience

SN - 1662-5153

M1 - 140

ER -