Article: Dean - A Real-Time fMRI-Based Spelling Device Immediately Enabling Robust Motor-Independent Communication

Dean's Stroke Musing

This is so cool, instead of just working on letters I bet they could mimic ASL and do words/phrases.  -- Dean's Stroke Musing. Original  article A Real-Time fMRI-Based Spelling ... 

Highlights

fMRI-based spelling device for potential communication with locked-in patients.  Each letter of the alphabet can be hemodynamically encoded by a single mental process. Evoked single-trial fMRI responses can be decoded in real time with high accuracy.  Requires almost zero pretraining; methods can be readily used at standard MRI site.

Summary

Human communication entirely depends on the functional integrity of the neuromuscular system. This is devastatingly illustrated in clinical conditions such as the so-called locked-in syndrome (LIS), in which severely motor-disabled patients become incapable to communicate naturally — while being fully conscious and awake. For the last 20 years, research on motor-independent communication has focused on developing brain-computer interfaces (BCIs) implementing neuroelectric signals for communication, and BCIs based on electroencephalography (EEG) have already been applied successfully to concerned patients. However, not all patients achieve proficiency in EEG-based BCI control. Thus, more recently, hemodynamic brain signals have also been explored for BCI purposes. Here, we introduce the first spelling device based on fMRI. By exploiting spatiotemporal characteristics of hemodynamic responses, evoked by performing differently timed mental imagery tasks, our novel letter encoding technique allows translating any freely chosen answer (letter-by-letter) into reliable and differentiable single-trial fMRI signals. Most importantly, automated letter decoding in real time enables back-and-forth communication within a single scanning session. Because the suggested spelling device requires only little effort and pretraining, it is immediately operational and possesses high potential for clinical applications, both in terms of diagnostics and establishing short-term communication with nonresponsive and severely motor-impaired patients.