Devaluation of outcomes due to their cost

Extending discounting models beyond delay

Research output: Chapter in Book/Report/Conference proceedingChapter

2 Citations (Scopus)

Abstract

Impulsivity is a profound source of poor decision making, often bringing suffering to both person and polity. Although impulsivity attends psychiatric disorders such as addiction, pathological gambling, attention deficit/hyperactivity disorder, and obsessive-compulsive disorder, almost everyone makes impulsive decisions that disregard the long-term consequences of our actions in favor of the near-term allure of immediate temptations. Deliberating between long-term benefits and short-term rewards is also a hallmark of foraging decisions, probably the most fundamental of all challenges confronted by mobile organisms. Behavioral studies confirm theoretical predictions that foragers compute the value of current offers, track background reward rates over different temporal and spatial scales, and update strategies in response to changes in the environment. These observations suggest that the execution of foraging computations is fundamental for understanding the organization of the nervous system. Here, we describe a process model for making foraging choices that integrates the value of short-term options and compares that value to a decision threshold determined by long-term reward rates. In addition, the role of interrupts and optimization routines are here incorporated for the first time into a foraging framework, by adapting decision thresholds to changes in the environment. A core network of brain areas, including the ventromedial prefrontal cortex, the anterior cingulate cortex, and the posterior cingulate cortex, under the modulatory influence of dopamine and norepinephrine, executes these computations and implements these processes. Our model provocatively implies that maladaptive impulsive choices can result from dysregulated foraging neurocircuitry.

Original languageEnglish (US)
Title of host publicationNebraska Symposium on Motivation
PublisherSpringer New York LLC
Pages145-161
Number of pages17
Volume64
DOIs
StatePublished - Apr 1 2017

Publication series

NameNebraska Symposium on Motivation
Volume64
ISSN (Print)01467875

Fingerprint

Reward
Impulsive Behavior
Gyrus Cinguli
Costs and Cost Analysis
Gambling
Obsessive-Compulsive Disorder
Attention Deficit Disorder with Hyperactivity
Prefrontal Cortex
Psychological Stress
Nervous System
Psychiatry
Dopamine
Decision Making
Norepinephrine
Theoretical Models
Organizations
Brain

ASJC Scopus subject areas

  • Social Psychology
  • Medicine(all)

Cite this

Mitchell, S. (2017). Devaluation of outcomes due to their cost: Extending discounting models beyond delay. In Nebraska Symposium on Motivation (Vol. 64, pp. 145-161). (Nebraska Symposium on Motivation; Vol. 64). Springer New York LLC. https://doi.org/10.1007/978-3-319-51721-6_5

Devaluation of outcomes due to their cost : Extending discounting models beyond delay. / Mitchell, Suzanne.

Nebraska Symposium on Motivation. Vol. 64 Springer New York LLC, 2017. p. 145-161 (Nebraska Symposium on Motivation; Vol. 64).

Research output: Chapter in Book/Report/Conference proceedingChapter

Mitchell, S 2017, Devaluation of outcomes due to their cost: Extending discounting models beyond delay. in Nebraska Symposium on Motivation. vol. 64, Nebraska Symposium on Motivation, vol. 64, Springer New York LLC, pp. 145-161. https://doi.org/10.1007/978-3-319-51721-6_5
Mitchell S. Devaluation of outcomes due to their cost: Extending discounting models beyond delay. In Nebraska Symposium on Motivation. Vol. 64. Springer New York LLC. 2017. p. 145-161. (Nebraska Symposium on Motivation). https://doi.org/10.1007/978-3-319-51721-6_5
Mitchell, Suzanne. / Devaluation of outcomes due to their cost : Extending discounting models beyond delay. Nebraska Symposium on Motivation. Vol. 64 Springer New York LLC, 2017. pp. 145-161 (Nebraska Symposium on Motivation).
@inbook{11fd27b9e56442fba513824b2bd7c5c2,
title = "Devaluation of outcomes due to their cost: Extending discounting models beyond delay",
abstract = "Impulsivity is a profound source of poor decision making, often bringing suffering to both person and polity. Although impulsivity attends psychiatric disorders such as addiction, pathological gambling, attention deficit/hyperactivity disorder, and obsessive-compulsive disorder, almost everyone makes impulsive decisions that disregard the long-term consequences of our actions in favor of the near-term allure of immediate temptations. Deliberating between long-term benefits and short-term rewards is also a hallmark of foraging decisions, probably the most fundamental of all challenges confronted by mobile organisms. Behavioral studies confirm theoretical predictions that foragers compute the value of current offers, track background reward rates over different temporal and spatial scales, and update strategies in response to changes in the environment. These observations suggest that the execution of foraging computations is fundamental for understanding the organization of the nervous system. Here, we describe a process model for making foraging choices that integrates the value of short-term options and compares that value to a decision threshold determined by long-term reward rates. In addition, the role of interrupts and optimization routines are here incorporated for the first time into a foraging framework, by adapting decision thresholds to changes in the environment. A core network of brain areas, including the ventromedial prefrontal cortex, the anterior cingulate cortex, and the posterior cingulate cortex, under the modulatory influence of dopamine and norepinephrine, executes these computations and implements these processes. Our model provocatively implies that maladaptive impulsive choices can result from dysregulated foraging neurocircuitry.",
author = "Suzanne Mitchell",
year = "2017",
month = "4",
day = "1",
doi = "10.1007/978-3-319-51721-6_5",
language = "English (US)",
volume = "64",
series = "Nebraska Symposium on Motivation",
publisher = "Springer New York LLC",
pages = "145--161",
booktitle = "Nebraska Symposium on Motivation",

}

TY - CHAP

T1 - Devaluation of outcomes due to their cost

T2 - Extending discounting models beyond delay

AU - Mitchell, Suzanne

PY - 2017/4/1

Y1 - 2017/4/1

N2 - Impulsivity is a profound source of poor decision making, often bringing suffering to both person and polity. Although impulsivity attends psychiatric disorders such as addiction, pathological gambling, attention deficit/hyperactivity disorder, and obsessive-compulsive disorder, almost everyone makes impulsive decisions that disregard the long-term consequences of our actions in favor of the near-term allure of immediate temptations. Deliberating between long-term benefits and short-term rewards is also a hallmark of foraging decisions, probably the most fundamental of all challenges confronted by mobile organisms. Behavioral studies confirm theoretical predictions that foragers compute the value of current offers, track background reward rates over different temporal and spatial scales, and update strategies in response to changes in the environment. These observations suggest that the execution of foraging computations is fundamental for understanding the organization of the nervous system. Here, we describe a process model for making foraging choices that integrates the value of short-term options and compares that value to a decision threshold determined by long-term reward rates. In addition, the role of interrupts and optimization routines are here incorporated for the first time into a foraging framework, by adapting decision thresholds to changes in the environment. A core network of brain areas, including the ventromedial prefrontal cortex, the anterior cingulate cortex, and the posterior cingulate cortex, under the modulatory influence of dopamine and norepinephrine, executes these computations and implements these processes. Our model provocatively implies that maladaptive impulsive choices can result from dysregulated foraging neurocircuitry.

AB - Impulsivity is a profound source of poor decision making, often bringing suffering to both person and polity. Although impulsivity attends psychiatric disorders such as addiction, pathological gambling, attention deficit/hyperactivity disorder, and obsessive-compulsive disorder, almost everyone makes impulsive decisions that disregard the long-term consequences of our actions in favor of the near-term allure of immediate temptations. Deliberating between long-term benefits and short-term rewards is also a hallmark of foraging decisions, probably the most fundamental of all challenges confronted by mobile organisms. Behavioral studies confirm theoretical predictions that foragers compute the value of current offers, track background reward rates over different temporal and spatial scales, and update strategies in response to changes in the environment. These observations suggest that the execution of foraging computations is fundamental for understanding the organization of the nervous system. Here, we describe a process model for making foraging choices that integrates the value of short-term options and compares that value to a decision threshold determined by long-term reward rates. In addition, the role of interrupts and optimization routines are here incorporated for the first time into a foraging framework, by adapting decision thresholds to changes in the environment. A core network of brain areas, including the ventromedial prefrontal cortex, the anterior cingulate cortex, and the posterior cingulate cortex, under the modulatory influence of dopamine and norepinephrine, executes these computations and implements these processes. Our model provocatively implies that maladaptive impulsive choices can result from dysregulated foraging neurocircuitry.

UR - http://www.scopus.com/inward/record.url?scp=85017150656&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85017150656&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-51721-6_5

DO - 10.1007/978-3-319-51721-6_5

M3 - Chapter

VL - 64

T3 - Nebraska Symposium on Motivation

SP - 145

EP - 161

BT - Nebraska Symposium on Motivation

PB - Springer New York LLC

ER -