A framework for rapid visual image search using single-trial brain evoked responses

Yonghong Huang, Deniz Erdogmus, Misha Pavel, Santosh Mathan, Kenneth E. Hild

Research output: Contribution to journalArticle

45 Scopus citations

Abstract

We report the design and performance of a brain computer interface for single-trial detection of viewed images based on human dynamic brain response signatures in 32-channel electroencephalography (EEG) acquired during a rapid serial visual presentation. The system explores the feasibility of speeding up image analysis by tapping into split-second perceptual judgments of humans. We present an incremental learning system with less memory storage and computational cost for single-trial event-related potential (ERP) detection, which is trained using cross-session data. We demonstrate the efficacy of the method on the task of target image detection. We apply linear and nonlinear support vector machines (SVMs) and a linear logistic classifier (LLC) for single-trial ERP detection using data collected from image analysts and naive subjects. For our data the detection performance of the nonlinear SVM is better than the linear SVM and the LLC. We also show that our ERP-based target detection system is five-fold faster than the traditional image viewing paradigm.

Original languageEnglish (US)
Pages (from-to)2041-2051
Number of pages11
JournalNeurocomputing
Volume74
Issue number12-13
DOIs
StatePublished - Jun 1 2011

    Fingerprint

Keywords

  • Brain computer interface (BCI)
  • Electroencephalography (EEG)
  • Image retrieval
  • Incremental learning
  • Single-trial event-related potential (ERP)

ASJC Scopus subject areas

  • Computer Science Applications
  • Cognitive Neuroscience
  • Artificial Intelligence

Cite this

Huang, Y., Erdogmus, D., Pavel, M., Mathan, S., & Hild, K. E. (2011). A framework for rapid visual image search using single-trial brain evoked responses. Neurocomputing, 74(12-13), 2041-2051. https://doi.org/10.1016/j.neucom.2010.12.025