Analysis and design of behavioral experiments to characterize population learning

Anne C. Smith, Mark R. Stefani, Bita Moghaddam, Emery N. Brown

Research output: Contribution to journalArticle

32 Citations (Scopus)

Abstract

In population learning studies, between-subject response differences are an important source of variance that must be characterized to identify accurately the features of the learning process common to the population. Although learning is a dynamic process, current population analyses do not use dynamic estimation methods, do not compute both population and individual learning curves, and use learning criteria that are less than optimal. We develop a state-space random effects (SSRE) model to estimate population and individual learning curves, ideal observer curves, and learning trials, and to make dynamic assessments of learning between two populations and within the same population that avoid multiple hypothesis tests. In an 80-trial study of an NMDA antagonist's effect on the ability of rats to execute a set-shift task, our dynamic assessments of learning demonstrated that both the treatment and control groups learned, yet, by trial 35, the treatment group learning was significantly impaired relative to control. We used our SSRE model in a theoretical study to evaluate the design efficiency of learning experiments in terms of the number of animals per group and number of trials per animal required to characterize learning differences between two populations. Our results demonstrated that a maximum difference in the probability of a correct response between the treatment and control group learning curves of 0.07 (0.20) would require 15 to 20 (5 to 7) animals per group in an 80 (60)-trial experiment. The SSRE model offers a practical approach to dynamic analysis of population learning and a theoretical framework for optimal design of learning experiments.

Original languageEnglish (US)
Pages (from-to)1776-1792
Number of pages17
JournalJournal of Neurophysiology
Volume93
Issue number3
DOIs
StatePublished - Mar 2005
Externally publishedYes

Fingerprint

Learning
Population
Learning Curve
Control Groups
Aptitude
Population Dynamics
N-Methylaspartate
Theoretical Models
Efficiency

ASJC Scopus subject areas

  • Neuroscience(all)
  • Physiology

Cite this

Analysis and design of behavioral experiments to characterize population learning. / Smith, Anne C.; Stefani, Mark R.; Moghaddam, Bita; Brown, Emery N.

In: Journal of Neurophysiology, Vol. 93, No. 3, 03.2005, p. 1776-1792.

Research output: Contribution to journalArticle

Smith, Anne C. ; Stefani, Mark R. ; Moghaddam, Bita ; Brown, Emery N. / Analysis and design of behavioral experiments to characterize population learning. In: Journal of Neurophysiology. 2005 ; Vol. 93, No. 3. pp. 1776-1792.
@article{6ee02e643d9a4b6a9bcf2ae3aa387887,
title = "Analysis and design of behavioral experiments to characterize population learning",
abstract = "In population learning studies, between-subject response differences are an important source of variance that must be characterized to identify accurately the features of the learning process common to the population. Although learning is a dynamic process, current population analyses do not use dynamic estimation methods, do not compute both population and individual learning curves, and use learning criteria that are less than optimal. We develop a state-space random effects (SSRE) model to estimate population and individual learning curves, ideal observer curves, and learning trials, and to make dynamic assessments of learning between two populations and within the same population that avoid multiple hypothesis tests. In an 80-trial study of an NMDA antagonist's effect on the ability of rats to execute a set-shift task, our dynamic assessments of learning demonstrated that both the treatment and control groups learned, yet, by trial 35, the treatment group learning was significantly impaired relative to control. We used our SSRE model in a theoretical study to evaluate the design efficiency of learning experiments in terms of the number of animals per group and number of trials per animal required to characterize learning differences between two populations. Our results demonstrated that a maximum difference in the probability of a correct response between the treatment and control group learning curves of 0.07 (0.20) would require 15 to 20 (5 to 7) animals per group in an 80 (60)-trial experiment. The SSRE model offers a practical approach to dynamic analysis of population learning and a theoretical framework for optimal design of learning experiments.",
author = "Smith, {Anne C.} and Stefani, {Mark R.} and Bita Moghaddam and Brown, {Emery N.}",
year = "2005",
month = "3",
doi = "10.1152/jn.00765.2004",
language = "English (US)",
volume = "93",
pages = "1776--1792",
journal = "Journal of Neurophysiology",
issn = "0022-3077",
publisher = "American Physiological Society",
number = "3",

}

TY - JOUR

T1 - Analysis and design of behavioral experiments to characterize population learning

AU - Smith, Anne C.

AU - Stefani, Mark R.

AU - Moghaddam, Bita

AU - Brown, Emery N.

PY - 2005/3

Y1 - 2005/3

N2 - In population learning studies, between-subject response differences are an important source of variance that must be characterized to identify accurately the features of the learning process common to the population. Although learning is a dynamic process, current population analyses do not use dynamic estimation methods, do not compute both population and individual learning curves, and use learning criteria that are less than optimal. We develop a state-space random effects (SSRE) model to estimate population and individual learning curves, ideal observer curves, and learning trials, and to make dynamic assessments of learning between two populations and within the same population that avoid multiple hypothesis tests. In an 80-trial study of an NMDA antagonist's effect on the ability of rats to execute a set-shift task, our dynamic assessments of learning demonstrated that both the treatment and control groups learned, yet, by trial 35, the treatment group learning was significantly impaired relative to control. We used our SSRE model in a theoretical study to evaluate the design efficiency of learning experiments in terms of the number of animals per group and number of trials per animal required to characterize learning differences between two populations. Our results demonstrated that a maximum difference in the probability of a correct response between the treatment and control group learning curves of 0.07 (0.20) would require 15 to 20 (5 to 7) animals per group in an 80 (60)-trial experiment. The SSRE model offers a practical approach to dynamic analysis of population learning and a theoretical framework for optimal design of learning experiments.

AB - In population learning studies, between-subject response differences are an important source of variance that must be characterized to identify accurately the features of the learning process common to the population. Although learning is a dynamic process, current population analyses do not use dynamic estimation methods, do not compute both population and individual learning curves, and use learning criteria that are less than optimal. We develop a state-space random effects (SSRE) model to estimate population and individual learning curves, ideal observer curves, and learning trials, and to make dynamic assessments of learning between two populations and within the same population that avoid multiple hypothesis tests. In an 80-trial study of an NMDA antagonist's effect on the ability of rats to execute a set-shift task, our dynamic assessments of learning demonstrated that both the treatment and control groups learned, yet, by trial 35, the treatment group learning was significantly impaired relative to control. We used our SSRE model in a theoretical study to evaluate the design efficiency of learning experiments in terms of the number of animals per group and number of trials per animal required to characterize learning differences between two populations. Our results demonstrated that a maximum difference in the probability of a correct response between the treatment and control group learning curves of 0.07 (0.20) would require 15 to 20 (5 to 7) animals per group in an 80 (60)-trial experiment. The SSRE model offers a practical approach to dynamic analysis of population learning and a theoretical framework for optimal design of learning experiments.

UR - http://www.scopus.com/inward/record.url?scp=14144252284&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=14144252284&partnerID=8YFLogxK

U2 - 10.1152/jn.00765.2004

DO - 10.1152/jn.00765.2004

M3 - Article

C2 - 15456798

AN - SCOPUS:14144252284

VL - 93

SP - 1776

EP - 1792

JO - Journal of Neurophysiology

JF - Journal of Neurophysiology

SN - 0022-3077

IS - 3

ER -