Decoding intended speech with an intracortical brain-computer interface in a person with longstanding anarthria and locked-in syndrome

Authors: Justin J. Jude, Stephanie Haro, Hadar Levi-Aharoni, Hiroaki Hashimoto, Alexander J. Acosta, Nicholas S. Card, Maitreyee Wairagkar, David M. Brandman, Sergey D. Stavisky, Ziv M. Williams, Sydney S. Cash, John D. Simeral, Leigh R. Hochberg, Daniel B. Rubin

Abstract: Intracortical brain-computer interfaces (iBCIs) for decoding intended speech have provided individuals with ALS and severe dysarthria an intuitive method for high-throughput communication. These advances have been demonstrated in individuals who are still able to vocalize and move speech articulators. Here, we decoded intended speech from an individual with longstanding anarthria, locked-in syndrome, and ventilator dependence due to advanced symptoms of ALS. We found that phonemes, words, and higher-order language units could be decoded well above chance. While sentence decoding accuracy was below that of demonstrations in participants with dysarthria, we are able to attain an extensive characterization of the neural signals underlying speech in a person with locked-in syndrome and through our results identify several directions for future improvement. These include closed-loop speech imagery training and decoding linguistic (rather than phonemic) units from neural signals in middle precentral gyrus. Overall, these results demonstrate that speech decoding from motor cortex may be feasible in people with anarthria and ventilator dependence. For individuals with longstanding anarthria, a purely phoneme-based decoding approach may lack the accuracy necessary to support independent use as a primary means of communication; however, additional linguistic information embedded within neural signals may provide a route to augment the performance of speech decoders.

Read the full pre-print here.

You might also like

Stimulus-specific recruitment of human amygdala neurons predicts episodic memory encoding success

Jessica Nani

Authors: Jiayang Xiao, Jonathan Daume, Yousef Salimpour, Natalia Kurilenko, Clayton Mosher, William S. Anderson, Taufik A. Valiante, Adam N. Mamelak, […]

Distinct contributions of memorability and object recognition to the representational goals of the macaque inferior temporal cortex

Jessica Nani

Authors: Soroush Ziaee, Ram Ahuja, Sabine Muzellec, Ezgi Fide, R. Shayna Rosenbaum, Kohitij Kar Abstract: The primate inferior temporal (IT) cortex, at the apex of the ventral visual stream, encodes information […]

Preparatory encoding of diverse features of intended movement in the human motor cortex

Jessica Nani

Authors: Mattia Rigotti-Thompson, Samuel R. Nason-Tomaszewski, Payton Bechefsky, Alexander Acosta, Nick Hahn, Donald Avansino, Brice Richards, Claire Nicolas, Yahia H. […]

Hippocampal stimulation reveals causal role of persistent neural activity in human working memory

Jessica Nani

Authors: Jonathan Daume, Mar Yebra, Chrystal M. Reed, Ivan Skelin, Yousef Salimpour, Jan Kamiński, Andre Cornejo Marin, William S. Anderson, Taufik A. Valiante, Adam N. Mamelak, Ueli Rutishauser Abstract: Working memory (WM) enables the temporary maintenance and manipulation of information, supporting […]

Intracortical microstimulation in humans: a decade of safety and efficacy

Jessica Nani

Abstract: Background Intracortical microstimulation (ICMS) of somatosensory cortex can restore a sense of touch to people with spinal cord injury (SCI). […]

TACTILE EDGES AND MOTION VIA PATTERNED MICROSTIMULATION OF THE HUMAN CORTEX

Jessica Nani

Authors: Giacomo Valle, Ali H. Alamari, Robin Lienkämper, John E. Downey, Anton R. Sobinov, Linnea J. Endsley, Dillan Prasad, Michael […]

Evidence for an active handoff between cerebral hemispheres during target tracking

Jessica Nani

Authors: Matthew B. Broschard, Jefferson E. Roy, Scott L. Brincat, Meredith K. Mahnke, Earl K. Miller Abstract: The brain has somewhat separate cognitive resources for the left and right […]

A streaming brain-to-voice neuroprosthesis to restore naturalistic communication

Jessica Nani

Authors: Kaylo T. Littlejohn, Cheol Jun Cho, Jessie R. Liu, Alexander B. Silva, Bohan Yu, Vanessa R. Anderson, Cady M. […]

A high-performance brain–computer interface for finger decoding and quadcopter game control in an individual with paralysis

Jessica Nani

We are thrilled to celebrate a remarkable milestone in neurotechnology: Using Blackrock Neurotech’s technology, researchers from Stanford University and the […]