RSVP keyboard: An EEG based typing interface

Umut Orhan, Kenneth E. Hild, Deniz Erdogmus, Brian Roark, Barry Oken, Melanie Fried-Oken

Research output: Chapter in Book/Report/Conference proceedingConference contribution

60 Citations (Scopus)

Abstract

Humans need communication. The desire to communicate remains one of the primary issues for people with locked-in syndrome (LIS). While many assistive and augmentative communication systems that use various physiological signals are available commercially, the need is not satisfactorily met. Brain interfaces, in particular, those that utilize event related potentials (ERP) in electroencephalography (EEG) to detect the intent of a person noninvasively, are emerging as a promising communication interface to meet this need where existing options are insufficient. Existing brain interfaces for typing use many repetitions of the visual stimuli in order to increase accuracy at the cost of speed. However, speed is also crucial and is an integral portion of peer-to-peer communication; a message that is not delivered timely often looses its importance. Consequently, we utilize rapid serial visual presentation (RSVP) in conjunction with language models in order to assist letter selection during the brain-typing process with the final goal of developing a system that achieves high accuracy and speed simultaneously. This paper presents initial results from the RSVP Keyboard system that is under development. These initial results on healthy and locked-in subjects show that single-trial or few-trial accurate letter selection may be possible with the RSVP Keyboard paradigm.

Original languageEnglish (US)
Title of host publicationICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
Pages645-648
Number of pages4
DOIs
StatePublished - 2012
Event2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012 - Kyoto, Japan
Duration: Mar 25 2012Mar 30 2012

Other

Other2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012
CountryJapan
CityKyoto
Period3/25/123/30/12

Fingerprint

Electroencephalography
Brain
Communication
Bioelectric potentials
Communication systems

Keywords

  • Bayesian fusion
  • Brain computer interface
  • event related potential
  • language model

ASJC Scopus subject areas

  • Signal Processing
  • Software
  • Electrical and Electronic Engineering

Cite this

Orhan, U., Hild, K. E., Erdogmus, D., Roark, B., Oken, B., & Fried-Oken, M. (2012). RSVP keyboard: An EEG based typing interface. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 645-648). [6287966] https://doi.org/10.1109/ICASSP.2012.6287966

RSVP keyboard : An EEG based typing interface. / Orhan, Umut; Hild, Kenneth E.; Erdogmus, Deniz; Roark, Brian; Oken, Barry; Fried-Oken, Melanie.

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. p. 645-648 6287966.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Orhan, U, Hild, KE, Erdogmus, D, Roark, B, Oken, B & Fried-Oken, M 2012, RSVP keyboard: An EEG based typing interface. in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings., 6287966, pp. 645-648, 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2012, Kyoto, Japan, 3/25/12. https://doi.org/10.1109/ICASSP.2012.6287966
Orhan U, Hild KE, Erdogmus D, Roark B, Oken B, Fried-Oken M. RSVP keyboard: An EEG based typing interface. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. p. 645-648. 6287966 https://doi.org/10.1109/ICASSP.2012.6287966
Orhan, Umut ; Hild, Kenneth E. ; Erdogmus, Deniz ; Roark, Brian ; Oken, Barry ; Fried-Oken, Melanie. / RSVP keyboard : An EEG based typing interface. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2012. pp. 645-648
@inproceedings{26d24566865149b999809b2a36b02787,
title = "RSVP keyboard: An EEG based typing interface",
abstract = "Humans need communication. The desire to communicate remains one of the primary issues for people with locked-in syndrome (LIS). While many assistive and augmentative communication systems that use various physiological signals are available commercially, the need is not satisfactorily met. Brain interfaces, in particular, those that utilize event related potentials (ERP) in electroencephalography (EEG) to detect the intent of a person noninvasively, are emerging as a promising communication interface to meet this need where existing options are insufficient. Existing brain interfaces for typing use many repetitions of the visual stimuli in order to increase accuracy at the cost of speed. However, speed is also crucial and is an integral portion of peer-to-peer communication; a message that is not delivered timely often looses its importance. Consequently, we utilize rapid serial visual presentation (RSVP) in conjunction with language models in order to assist letter selection during the brain-typing process with the final goal of developing a system that achieves high accuracy and speed simultaneously. This paper presents initial results from the RSVP Keyboard system that is under development. These initial results on healthy and locked-in subjects show that single-trial or few-trial accurate letter selection may be possible with the RSVP Keyboard paradigm.",
keywords = "Bayesian fusion, Brain computer interface, event related potential, language model",
author = "Umut Orhan and Hild, {Kenneth E.} and Deniz Erdogmus and Brian Roark and Barry Oken and Melanie Fried-Oken",
year = "2012",
doi = "10.1109/ICASSP.2012.6287966",
language = "English (US)",
isbn = "9781467300469",
pages = "645--648",
booktitle = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

}

TY - GEN

T1 - RSVP keyboard

T2 - An EEG based typing interface

AU - Orhan, Umut

AU - Hild, Kenneth E.

AU - Erdogmus, Deniz

AU - Roark, Brian

AU - Oken, Barry

AU - Fried-Oken, Melanie

PY - 2012

Y1 - 2012

N2 - Humans need communication. The desire to communicate remains one of the primary issues for people with locked-in syndrome (LIS). While many assistive and augmentative communication systems that use various physiological signals are available commercially, the need is not satisfactorily met. Brain interfaces, in particular, those that utilize event related potentials (ERP) in electroencephalography (EEG) to detect the intent of a person noninvasively, are emerging as a promising communication interface to meet this need where existing options are insufficient. Existing brain interfaces for typing use many repetitions of the visual stimuli in order to increase accuracy at the cost of speed. However, speed is also crucial and is an integral portion of peer-to-peer communication; a message that is not delivered timely often looses its importance. Consequently, we utilize rapid serial visual presentation (RSVP) in conjunction with language models in order to assist letter selection during the brain-typing process with the final goal of developing a system that achieves high accuracy and speed simultaneously. This paper presents initial results from the RSVP Keyboard system that is under development. These initial results on healthy and locked-in subjects show that single-trial or few-trial accurate letter selection may be possible with the RSVP Keyboard paradigm.

AB - Humans need communication. The desire to communicate remains one of the primary issues for people with locked-in syndrome (LIS). While many assistive and augmentative communication systems that use various physiological signals are available commercially, the need is not satisfactorily met. Brain interfaces, in particular, those that utilize event related potentials (ERP) in electroencephalography (EEG) to detect the intent of a person noninvasively, are emerging as a promising communication interface to meet this need where existing options are insufficient. Existing brain interfaces for typing use many repetitions of the visual stimuli in order to increase accuracy at the cost of speed. However, speed is also crucial and is an integral portion of peer-to-peer communication; a message that is not delivered timely often looses its importance. Consequently, we utilize rapid serial visual presentation (RSVP) in conjunction with language models in order to assist letter selection during the brain-typing process with the final goal of developing a system that achieves high accuracy and speed simultaneously. This paper presents initial results from the RSVP Keyboard system that is under development. These initial results on healthy and locked-in subjects show that single-trial or few-trial accurate letter selection may be possible with the RSVP Keyboard paradigm.

KW - Bayesian fusion

KW - Brain computer interface

KW - event related potential

KW - language model

UR - http://www.scopus.com/inward/record.url?scp=84867621118&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867621118&partnerID=8YFLogxK

U2 - 10.1109/ICASSP.2012.6287966

DO - 10.1109/ICASSP.2012.6287966

M3 - Conference contribution

AN - SCOPUS:84867621118

SN - 9781467300469

SP - 645

EP - 648

BT - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

ER -