Estimation of psychometric functions from adaptive tracking procedures

Marjorie R. Leek, Thomas E. Hanna, Lynne Marshall

Research output: Contribution to journalArticle

70 Citations (Scopus)

Abstract

Because adaptive tracking procedures are designed to avoid stimulus levels far from a target threshold value, the psychometric function constructed from the trial-by-trial data in the track may be accurate near the target level but a poor reflection of performance at levels far removed from the target. A series of computer simulations was undertaken to assess the reliability and accuracy of psychometric functions generated from data collected in up-down adaptive tracking procedures. Estimates of psychometric function slopes were obtained from-trial-by-trial data in simulated adaptive tracks and compared with the true characteristics of the functions used to generate the tracks. Simulations were carried out for three psychophysical procedures and two target performance levels, with tracks generated by psychometric functions with three different slopes. The functions reconstructed from the tracking data were, for the most part, accurate reflections of the true generating functions when at least 200 trials were included in the tracks. However, for 50- and 100-trial tracks, slope estimates were biased high for all simulated experimental conditions. Correction factors for slope estimates from these tracks are presented. There was no difference in the accuracy and reliability of slope estimation due to -target-level-for the adaptive track, and only minor differences due to psychophysical procedure. It is recommended that, if both threshold and slope of psychometric functions are to be estimated-from the trial-by-trial tracking data, at least 100 trials should be included in the tracks, and a three- or four-alternative forced-choice procedure should be used. However, good estimates can also be obtained using the two-alternative forced-choice procedure or less than 100 trials if appropriate corrections for bias are applied.

Original languageEnglish (US)
Pages (from-to)247-256
Number of pages10
JournalPerception & Psychophysics
Volume51
Issue number3
DOIs
StatePublished - May 1992

Fingerprint

Psychometrics
psychometrics
Computer Simulation
computer simulation
performance
stimulus
simulation
trend

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Sensory Systems
  • Psychology(all)

Cite this

Estimation of psychometric functions from adaptive tracking procedures. / Leek, Marjorie R.; Hanna, Thomas E.; Marshall, Lynne.

In: Perception & Psychophysics, Vol. 51, No. 3, 05.1992, p. 247-256.

Research output: Contribution to journalArticle

Leek, Marjorie R. ; Hanna, Thomas E. ; Marshall, Lynne. / Estimation of psychometric functions from adaptive tracking procedures. In: Perception & Psychophysics. 1992 ; Vol. 51, No. 3. pp. 247-256.
@article{c6062e68bd3e4c5bbfbb154a702b5e7d,
title = "Estimation of psychometric functions from adaptive tracking procedures",
abstract = "Because adaptive tracking procedures are designed to avoid stimulus levels far from a target threshold value, the psychometric function constructed from the trial-by-trial data in the track may be accurate near the target level but a poor reflection of performance at levels far removed from the target. A series of computer simulations was undertaken to assess the reliability and accuracy of psychometric functions generated from data collected in up-down adaptive tracking procedures. Estimates of psychometric function slopes were obtained from-trial-by-trial data in simulated adaptive tracks and compared with the true characteristics of the functions used to generate the tracks. Simulations were carried out for three psychophysical procedures and two target performance levels, with tracks generated by psychometric functions with three different slopes. The functions reconstructed from the tracking data were, for the most part, accurate reflections of the true generating functions when at least 200 trials were included in the tracks. However, for 50- and 100-trial tracks, slope estimates were biased high for all simulated experimental conditions. Correction factors for slope estimates from these tracks are presented. There was no difference in the accuracy and reliability of slope estimation due to -target-level-for the adaptive track, and only minor differences due to psychophysical procedure. It is recommended that, if both threshold and slope of psychometric functions are to be estimated-from the trial-by-trial tracking data, at least 100 trials should be included in the tracks, and a three- or four-alternative forced-choice procedure should be used. However, good estimates can also be obtained using the two-alternative forced-choice procedure or less than 100 trials if appropriate corrections for bias are applied.",
author = "Leek, {Marjorie R.} and Hanna, {Thomas E.} and Lynne Marshall",
year = "1992",
month = "5",
doi = "10.3758/BF03212251",
language = "English (US)",
volume = "51",
pages = "247--256",
journal = "Attention, Perception, and Psychophysics",
issn = "1943-3921",
publisher = "Springer New York",
number = "3",

}

TY - JOUR

T1 - Estimation of psychometric functions from adaptive tracking procedures

AU - Leek, Marjorie R.

AU - Hanna, Thomas E.

AU - Marshall, Lynne

PY - 1992/5

Y1 - 1992/5

N2 - Because adaptive tracking procedures are designed to avoid stimulus levels far from a target threshold value, the psychometric function constructed from the trial-by-trial data in the track may be accurate near the target level but a poor reflection of performance at levels far removed from the target. A series of computer simulations was undertaken to assess the reliability and accuracy of psychometric functions generated from data collected in up-down adaptive tracking procedures. Estimates of psychometric function slopes were obtained from-trial-by-trial data in simulated adaptive tracks and compared with the true characteristics of the functions used to generate the tracks. Simulations were carried out for three psychophysical procedures and two target performance levels, with tracks generated by psychometric functions with three different slopes. The functions reconstructed from the tracking data were, for the most part, accurate reflections of the true generating functions when at least 200 trials were included in the tracks. However, for 50- and 100-trial tracks, slope estimates were biased high for all simulated experimental conditions. Correction factors for slope estimates from these tracks are presented. There was no difference in the accuracy and reliability of slope estimation due to -target-level-for the adaptive track, and only minor differences due to psychophysical procedure. It is recommended that, if both threshold and slope of psychometric functions are to be estimated-from the trial-by-trial tracking data, at least 100 trials should be included in the tracks, and a three- or four-alternative forced-choice procedure should be used. However, good estimates can also be obtained using the two-alternative forced-choice procedure or less than 100 trials if appropriate corrections for bias are applied.

AB - Because adaptive tracking procedures are designed to avoid stimulus levels far from a target threshold value, the psychometric function constructed from the trial-by-trial data in the track may be accurate near the target level but a poor reflection of performance at levels far removed from the target. A series of computer simulations was undertaken to assess the reliability and accuracy of psychometric functions generated from data collected in up-down adaptive tracking procedures. Estimates of psychometric function slopes were obtained from-trial-by-trial data in simulated adaptive tracks and compared with the true characteristics of the functions used to generate the tracks. Simulations were carried out for three psychophysical procedures and two target performance levels, with tracks generated by psychometric functions with three different slopes. The functions reconstructed from the tracking data were, for the most part, accurate reflections of the true generating functions when at least 200 trials were included in the tracks. However, for 50- and 100-trial tracks, slope estimates were biased high for all simulated experimental conditions. Correction factors for slope estimates from these tracks are presented. There was no difference in the accuracy and reliability of slope estimation due to -target-level-for the adaptive track, and only minor differences due to psychophysical procedure. It is recommended that, if both threshold and slope of psychometric functions are to be estimated-from the trial-by-trial tracking data, at least 100 trials should be included in the tracks, and a three- or four-alternative forced-choice procedure should be used. However, good estimates can also be obtained using the two-alternative forced-choice procedure or less than 100 trials if appropriate corrections for bias are applied.

UR - http://www.scopus.com/inward/record.url?scp=0026826301&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026826301&partnerID=8YFLogxK

U2 - 10.3758/BF03212251

DO - 10.3758/BF03212251

M3 - Article

C2 - 1561050

AN - SCOPUS:0026826301

VL - 51

SP - 247

EP - 256

JO - Attention, Perception, and Psychophysics

JF - Attention, Perception, and Psychophysics

SN - 1943-3921

IS - 3

ER -