Decoding intended speech with an intracortical brain-computer interface in a person with longstanding anarthria and locked-in syndrome

Authors: Justin J. Jude, Stephanie Haro, Hadar Levi-Aharoni, Hiroaki Hashimoto, Alexander J. Acosta, Nicholas S. Card, Maitreyee Wairagkar, David M. Brandman, Sergey D. Stavisky, Ziv M. Williams, Sydney S. Cash, John D. Simeral, Leigh R. Hochberg, Daniel B. Rubin

Abstract: Intracortical brain-computer interfaces (iBCIs) for decoding intended speech have provided individuals with ALS and severe dysarthria an intuitive method for high-throughput communication. These advances have been demonstrated in individuals who are still able to vocalize and move speech articulators. Here, we decoded intended speech from an individual with longstanding anarthria, locked-in syndrome, and ventilator dependence due to advanced symptoms of ALS. We found that phonemes, words, and higher-order language units could be decoded well above chance. While sentence decoding accuracy was below that of demonstrations in participants with dysarthria, we are able to attain an extensive characterization of the neural signals underlying speech in a person with locked-in syndrome and through our results identify several directions for future improvement. These include closed-loop speech imagery training and decoding linguistic (rather than phonemic) units from neural signals in middle precentral gyrus. Overall, these results demonstrate that speech decoding from motor cortex may be feasible in people with anarthria and ventilator dependence. For individuals with longstanding anarthria, a purely phoneme-based decoding approach may lack the accuracy necessary to support independent use as a primary means of communication; however, additional linguistic information embedded within neural signals may provide a route to augment the performance of speech decoders.

Read the full pre-print here.

You might also like

Decoding Inner Speech with an End-to-End Brain-to-Text Neural Interface

Jessica Nani

Authors: Yizi Zhang, Linyang He, Chaofei Fan, Tingkai Liu, Han Yu, Trung Le, Jingyuan Li, Scott Linderman, Lea Duncker, Francis […]

Transient frontopolar cortex stimulation induces prolonged disruption to counterfactual processing

Jessica Nani

Authors: Matthew Ainsworth, Juan M. Galeazzi , Carlos Pedreira, Mark G. Stokes, Mark J. Buckley Abstract: Frontopolar cortex (FPC) contains […]

Hierarchical and Context-Dependent Encoding of Actions in Human Posterior Parietal and Motor Cortex

Jessica Nani

Authors: V. Bougou, J. Gamez, E. R. Rosario, C. Liu, K. Pejsa, A. Bari, R. A. Andersen Abstract: Action understanding requires internal models that link vision to motor goals. In monkeys, mirror neurons […]

Brain-like neural dynamics for behavioral control develop through reinforcement learning

Jessica Nani

Authors: Olivier Codol,  Nanda H. Krishna,  Guillaume Lajoie, Matthew G. Perich Abstract: During development, neural circuits are shaped continuously as we learn to control our bodies. The […]

Stimulus-specific recruitment of human amygdala neurons predicts episodic memory encoding success

Jessica Nani

Authors: Jiayang Xiao, Jonathan Daume, Yousef Salimpour, Natalia Kurilenko, Clayton Mosher, William S. Anderson, Taufik A. Valiante, Adam N. Mamelak, […]

Distinct contributions of memorability and object recognition to the representational goals of the macaque inferior temporal cortex

Jessica Nani

Authors: Soroush Ziaee, Ram Ahuja, Sabine Muzellec, Ezgi Fide, R. Shayna Rosenbaum, Kohitij Kar Abstract: The primate inferior temporal (IT) cortex, at the apex of the ventral visual stream, encodes information […]

Preparatory encoding of diverse features of intended movement in the human motor cortex

Jessica Nani

Authors: Mattia Rigotti-Thompson, Samuel R. Nason-Tomaszewski, Payton Bechefsky, Alexander Acosta, Nick Hahn, Donald Avansino, Brice Richards, Claire Nicolas, Yahia H. […]

Hippocampal stimulation reveals causal role of persistent neural activity in human working memory

Jessica Nani

Authors: Jonathan Daume, Mar Yebra, Chrystal M. Reed, Ivan Skelin, Yousef Salimpour, Jan Kamiński, Andre Cornejo Marin, William S. Anderson, Taufik A. Valiante, Adam N. Mamelak, Ueli Rutishauser Abstract: Working memory (WM) enables the temporary maintenance and manipulation of information, supporting […]

Intracortical microstimulation in humans: a decade of safety and efficacy

Jessica Nani

Abstract: Background Intracortical microstimulation (ICMS) of somatosensory cortex can restore a sense of touch to people with spinal cord injury (SCI). […]