Context information significantly improves brain computer interface performance - A case study on text entry using a language model assisted BCI

Umut Orhan, Deniz Erdogmus, Kenneth E. Hild, Brian Roark, Barry Oken, Melanie Fried-Oken

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

We present recent results on the design of the RSVP Keyboard - a brain computer interface (BCI) for expressive language generation for functionally locked-in individuals using rapid serial visual presentation of letters or other symbols such as icons. The proposed BCI design tightly incorporates probabilistic contextual information obtained from a language model into the single or multi-trial event related potential (ERP) decision mechanism. This tight fusion of contextual information with instantaneous and independent brain activity is demonstrated to potentially improve accuracy in a dramatic manner. Specifically, a simple regularized discriminant single-trial ERP classifier's performance can be increased from a naive baseline of 75% to 98% in a 28-symbol alphabet operating at 5% false ERP detection rate.We also demonstrate results which show that trained healthy subjects can achieve real-time typing accuracies over 90% mostly relying on single-trial ERP evidence when supplemented with a rudimentary n-gram language model. Further discussion and preliminary results include our initial efforts involving a locked-in individual and our efforts to train him to improve his skill in performing the task.

Original languageEnglish (US)
Title of host publicationConference Record of the 45th Asilomar Conference on Signals, Systems and Computers, ASILOMAR 2011
Pages132-136
Number of pages5
DOIs
StatePublished - 2011
Event45th Asilomar Conference on Signals, Systems and Computers, ASILOMAR 2011 - Pacific Grove, CA, United States
Duration: Nov 6 2011Nov 9 2011

Publication series

NameConference Record - Asilomar Conference on Signals, Systems and Computers
ISSN (Print)1058-6393

Other

Other45th Asilomar Conference on Signals, Systems and Computers, ASILOMAR 2011
CountryUnited States
CityPacific Grove, CA
Period11/6/1111/9/11

ASJC Scopus subject areas

  • Signal Processing
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Context information significantly improves brain computer interface performance - A case study on text entry using a language model assisted BCI'. Together they form a unique fingerprint.

  • Cite this

    Orhan, U., Erdogmus, D., Hild, K. E., Roark, B., Oken, B., & Fried-Oken, M. (2011). Context information significantly improves brain computer interface performance - A case study on text entry using a language model assisted BCI. In Conference Record of the 45th Asilomar Conference on Signals, Systems and Computers, ASILOMAR 2011 (pp. 132-136). [6189970] (Conference Record - Asilomar Conference on Signals, Systems and Computers). https://doi.org/10.1109/ACSSC.2011.6189970