Neural correlates of visual perception in rapid serial visual presentation paradigms

Yonghong Huang, Kenneth E. Hild, Misha Pavel, Santosh Mathan, Deniz Erdogmus

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Human brain signals associated with visual perceptual processes have been used for image recognition. This paper presents several insights on the neural correlates of human visual perception by analyzing the neural correlates that result when humans view realistic images using a rapid serial visual presentation (RSVP) image display paradigm. We propose an image information extraction model and examine the relationship between the brain evoked response - using event related potential (ERP) characteristics - and the level of difficulty for humans to detect targets as a function of both visual stimulus complexity and task difficulty. We develop a computational model to quantify subject performance and the difficulty of realistic stimuli. Our results show that: (1) more difficult trials produce less prominent ERP patterns, thus reducing the performance of machine-based ERP detection; (2) on average for the same behavioral performance level, a pair of ERP's extracted from two easy trials are more similar than a pair of ERP's from two hard trials; and (3) both stimulus and task difficulty are correlated with neural activity. Our findings indicate that, for dynamic tasks involved in visual information processing, the brain may allocate additional cognitive resources, such as attention, to a given visual stimulus, as the task and/or stimulus difficulty increases.

Original languageEnglish (US)
Title of host publicationIEEE International Workshop on Machine Learning for Signal Processing, MLSP
DOIs
StatePublished - 2012
Event2012 22nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2012 - Santander, Spain
Duration: Sep 23 2012Sep 26 2012

Other

Other2012 22nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2012
CountrySpain
CitySantander
Period9/23/129/26/12

Fingerprint

Brain
Enterprise resource planning
Image recognition
Display devices

Keywords

  • Electroencephalography (EEG)
  • event related potential (ERP)
  • rapid serial visual presentation
  • stimulus complexity
  • task difficulty
  • visual information processing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Signal Processing

Cite this

Huang, Y., Hild, K. E., Pavel, M., Mathan, S., & Erdogmus, D. (2012). Neural correlates of visual perception in rapid serial visual presentation paradigms. In IEEE International Workshop on Machine Learning for Signal Processing, MLSP [6349766] https://doi.org/10.1109/MLSP.2012.6349766

Neural correlates of visual perception in rapid serial visual presentation paradigms. / Huang, Yonghong; Hild, Kenneth E.; Pavel, Misha; Mathan, Santosh; Erdogmus, Deniz.

IEEE International Workshop on Machine Learning for Signal Processing, MLSP. 2012. 6349766.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Huang, Y, Hild, KE, Pavel, M, Mathan, S & Erdogmus, D 2012, Neural correlates of visual perception in rapid serial visual presentation paradigms. in IEEE International Workshop on Machine Learning for Signal Processing, MLSP., 6349766, 2012 22nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2012, Santander, Spain, 9/23/12. https://doi.org/10.1109/MLSP.2012.6349766
Huang Y, Hild KE, Pavel M, Mathan S, Erdogmus D. Neural correlates of visual perception in rapid serial visual presentation paradigms. In IEEE International Workshop on Machine Learning for Signal Processing, MLSP. 2012. 6349766 https://doi.org/10.1109/MLSP.2012.6349766
Huang, Yonghong ; Hild, Kenneth E. ; Pavel, Misha ; Mathan, Santosh ; Erdogmus, Deniz. / Neural correlates of visual perception in rapid serial visual presentation paradigms. IEEE International Workshop on Machine Learning for Signal Processing, MLSP. 2012.
@inproceedings{c7d55b23f10c4c54b5d932579f621969,
title = "Neural correlates of visual perception in rapid serial visual presentation paradigms",
abstract = "Human brain signals associated with visual perceptual processes have been used for image recognition. This paper presents several insights on the neural correlates of human visual perception by analyzing the neural correlates that result when humans view realistic images using a rapid serial visual presentation (RSVP) image display paradigm. We propose an image information extraction model and examine the relationship between the brain evoked response - using event related potential (ERP) characteristics - and the level of difficulty for humans to detect targets as a function of both visual stimulus complexity and task difficulty. We develop a computational model to quantify subject performance and the difficulty of realistic stimuli. Our results show that: (1) more difficult trials produce less prominent ERP patterns, thus reducing the performance of machine-based ERP detection; (2) on average for the same behavioral performance level, a pair of ERP's extracted from two easy trials are more similar than a pair of ERP's from two hard trials; and (3) both stimulus and task difficulty are correlated with neural activity. Our findings indicate that, for dynamic tasks involved in visual information processing, the brain may allocate additional cognitive resources, such as attention, to a given visual stimulus, as the task and/or stimulus difficulty increases.",
keywords = "Electroencephalography (EEG), event related potential (ERP), rapid serial visual presentation, stimulus complexity, task difficulty, visual information processing",
author = "Yonghong Huang and Hild, {Kenneth E.} and Misha Pavel and Santosh Mathan and Deniz Erdogmus",
year = "2012",
doi = "10.1109/MLSP.2012.6349766",
language = "English (US)",
isbn = "9781467310260",
booktitle = "IEEE International Workshop on Machine Learning for Signal Processing, MLSP",

}

TY - GEN

T1 - Neural correlates of visual perception in rapid serial visual presentation paradigms

AU - Huang, Yonghong

AU - Hild, Kenneth E.

AU - Pavel, Misha

AU - Mathan, Santosh

AU - Erdogmus, Deniz

PY - 2012

Y1 - 2012

N2 - Human brain signals associated with visual perceptual processes have been used for image recognition. This paper presents several insights on the neural correlates of human visual perception by analyzing the neural correlates that result when humans view realistic images using a rapid serial visual presentation (RSVP) image display paradigm. We propose an image information extraction model and examine the relationship between the brain evoked response - using event related potential (ERP) characteristics - and the level of difficulty for humans to detect targets as a function of both visual stimulus complexity and task difficulty. We develop a computational model to quantify subject performance and the difficulty of realistic stimuli. Our results show that: (1) more difficult trials produce less prominent ERP patterns, thus reducing the performance of machine-based ERP detection; (2) on average for the same behavioral performance level, a pair of ERP's extracted from two easy trials are more similar than a pair of ERP's from two hard trials; and (3) both stimulus and task difficulty are correlated with neural activity. Our findings indicate that, for dynamic tasks involved in visual information processing, the brain may allocate additional cognitive resources, such as attention, to a given visual stimulus, as the task and/or stimulus difficulty increases.

AB - Human brain signals associated with visual perceptual processes have been used for image recognition. This paper presents several insights on the neural correlates of human visual perception by analyzing the neural correlates that result when humans view realistic images using a rapid serial visual presentation (RSVP) image display paradigm. We propose an image information extraction model and examine the relationship between the brain evoked response - using event related potential (ERP) characteristics - and the level of difficulty for humans to detect targets as a function of both visual stimulus complexity and task difficulty. We develop a computational model to quantify subject performance and the difficulty of realistic stimuli. Our results show that: (1) more difficult trials produce less prominent ERP patterns, thus reducing the performance of machine-based ERP detection; (2) on average for the same behavioral performance level, a pair of ERP's extracted from two easy trials are more similar than a pair of ERP's from two hard trials; and (3) both stimulus and task difficulty are correlated with neural activity. Our findings indicate that, for dynamic tasks involved in visual information processing, the brain may allocate additional cognitive resources, such as attention, to a given visual stimulus, as the task and/or stimulus difficulty increases.

KW - Electroencephalography (EEG)

KW - event related potential (ERP)

KW - rapid serial visual presentation

KW - stimulus complexity

KW - task difficulty

KW - visual information processing

UR - http://www.scopus.com/inward/record.url?scp=84870707885&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84870707885&partnerID=8YFLogxK

U2 - 10.1109/MLSP.2012.6349766

DO - 10.1109/MLSP.2012.6349766

M3 - Conference contribution

SN - 9781467310260

BT - IEEE International Workshop on Machine Learning for Signal Processing, MLSP

ER -