People with severe speech and physical impairments can benefit from a direct brain computer interface for their communication needs. This project aims to develop an AAC interface using noninvasive EEG sensors to infer the user’s intent regarding desired letters and symbols during text generation. The designed RSVP Keyboard system will utilize rapid serial visual presentation of letter sequences coupled with probabilistic and adaptive open vocabulary language models and EEG signal processing and classification algorithms. The designed brain interface relies on event related potentials including the P300 signal. The project design tightly couples feedback from locked-in consultants who will test the system design at regular intervals and provide critical feedback in future design improvements.

Funding National Science Foundation (IIS-1149570, CNS-1544895, IIS-1715858), Department of Health and Human Services  (90RE5017-02-01), and National Institutes of Health (R01DC009834)