Neural correlates of visual perception in rapid serial visual presentation paradigms

Yonghong Huang, Kenneth E. Hild, Misha Pavel, Santosh Mathan, Deniz Erdogmus

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Human brain signals associated with visual perceptual processes have been used for image recognition. This paper presents several insights on the neural correlates of human visual perception by analyzing the neural correlates that result when humans view realistic images using a rapid serial visual presentation (RSVP) image display paradigm. We propose an image information extraction model and examine the relationship between the brain evoked response - using event related potential (ERP) characteristics - and the level of difficulty for humans to detect targets as a function of both visual stimulus complexity and task difficulty. We develop a computational model to quantify subject performance and the difficulty of realistic stimuli. Our results show that: (1) more difficult trials produce less prominent ERP patterns, thus reducing the performance of machine-based ERP detection; (2) on average for the same behavioral performance level, a pair of ERP's extracted from two easy trials are more similar than a pair of ERP's from two hard trials; and (3) both stimulus and task difficulty are correlated with neural activity. Our findings indicate that, for dynamic tasks involved in visual information processing, the brain may allocate additional cognitive resources, such as attention, to a given visual stimulus, as the task and/or stimulus difficulty increases.

Original languageEnglish (US)
Title of host publication2012 IEEE International Workshop on Machine Learning for Signal Processing - Proceedings of MLSP 2012
DOIs
StatePublished - Dec 12 2012
Event2012 22nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2012 - Santander, Spain
Duration: Sep 23 2012Sep 26 2012

Publication series

NameIEEE International Workshop on Machine Learning for Signal Processing, MLSP
ISSN (Print)2161-0363
ISSN (Electronic)2161-0371

Other

Other2012 22nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2012
CountrySpain
CitySantander
Period9/23/129/26/12

Keywords

  • Electroencephalography (EEG)
  • event related potential (ERP)
  • rapid serial visual presentation
  • stimulus complexity
  • task difficulty
  • visual information processing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Signal Processing

Fingerprint Dive into the research topics of 'Neural correlates of visual perception in rapid serial visual presentation paradigms'. Together they form a unique fingerprint.

  • Cite this

    Huang, Y., Hild, K. E., Pavel, M., Mathan, S., & Erdogmus, D. (2012). Neural correlates of visual perception in rapid serial visual presentation paradigms. In 2012 IEEE International Workshop on Machine Learning for Signal Processing - Proceedings of MLSP 2012 [6349766] (IEEE International Workshop on Machine Learning for Signal Processing, MLSP). https://doi.org/10.1109/MLSP.2012.6349766