TY - JOUR
T1 - Multi-sensory integration of spatio-temporal segmentation cues
T2 - One plus one does not always equal two
AU - Zhou, Feng
AU - Wong, Victoria
AU - Sekuler, Robert
N1 - Funding Information:
Acknowledgments We thank Larry Abbott, Yuko Yotsumoto, Takeo Watanabe, Allison B. Sekuler, and Kristina Visscher for excellent suggestions. Feng Zhou is now at the Department of Psychological and Brain Sciences, the Johns Hopkins University. Victoria Wong was supported by an NSF IGERT fellowship, and by an undergraduate research grant; she is currently at the School of Medicine, University of Hawaii. Research supported by AFOSR grant F49620-03-1-0376 and National Institutes of Health grant MH-55687. e-mail: sekuler@brandeis.edu.
PY - 2007/7
Y1 - 2007/7
N2 - How are multiple, multi-sensory stimuli combined for use in segmenting spatio-temporal events? For an answer, we measured the effect of various auditory or visual stimuli, in isolation or in combination, on a bistable percept of visual motion ("bouncing" vs. "streaming"). To minimize individual differences, the physical properties of stimuli were adjusted to reflect individual subjects' sensitivity to each cue in isolation. When put into combination, perceptual influences that had been equipotent in isolation were substantially altered. Specifically, auditory cues that had been strong when presented alone were greatly reduced in combination. Evaluation of alternative models of sensory integration showed that the state of the visual bistable percept could not be accounted for by probability summation among cues, as might occur at the level of decision processes. Instead, the state of the bistable percept was well predicted from a weighted sum of cues, with visual cues strongly dominating auditory cues. Finally, when cue weights were compared for individual subjects, it was found that subjects differ somewhat in the strategy they use for integrating multi-sensory information.
AB - How are multiple, multi-sensory stimuli combined for use in segmenting spatio-temporal events? For an answer, we measured the effect of various auditory or visual stimuli, in isolation or in combination, on a bistable percept of visual motion ("bouncing" vs. "streaming"). To minimize individual differences, the physical properties of stimuli were adjusted to reflect individual subjects' sensitivity to each cue in isolation. When put into combination, perceptual influences that had been equipotent in isolation were substantially altered. Specifically, auditory cues that had been strong when presented alone were greatly reduced in combination. Evaluation of alternative models of sensory integration showed that the state of the visual bistable percept could not be accounted for by probability summation among cues, as might occur at the level of decision processes. Instead, the state of the bistable percept was well predicted from a weighted sum of cues, with visual cues strongly dominating auditory cues. Finally, when cue weights were compared for individual subjects, it was found that subjects differ somewhat in the strategy they use for integrating multi-sensory information.
UR - http://www.scopus.com/inward/record.url?scp=34250858321&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34250858321&partnerID=8YFLogxK
U2 - 10.1007/s00221-007-0897-0
DO - 10.1007/s00221-007-0897-0
M3 - Article
C2 - 17333010
AN - SCOPUS:34250858321
SN - 0014-4819
VL - 180
SP - 641
EP - 654
JO - Experimental Brain Research
JF - Experimental Brain Research
IS - 4
ER -