Sunday, May 11, 2025 5/11/2025

Understanding and restoring speech production using an intracortical brain-computer interface

Award Number: DP2DC021055
ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

Group Awards By:

View Award Description

Understanding and restoring speech production using an intracortical brain-computer interface - PROJECT SUMMARY / ABSTRACT The goal of this proposal is to improve our fundamental understanding of speech production, and to translate this knowledge into medical devices called intracortical brain-computer interfaces (iBCIs) that will enable people who have lost the ability to speak to fluently communicate via a computer just by trying to speak. The study will enroll participants who have lost or are actively losing their ability to as part of the ongoing BrainGate2 clinical trial (a multi- site trial investigating the feasibility and safety of iBCIs in people with paralysis.) We will place four chronic 64- channel silicon microelectrode arrays in speech areas of cortex and use simultaneously recorded speech (or attempted speech) data and action potential-resolution neural data to characterize and decode in real time the link between neural activity and speech production. A key advance of this approach is our ability to record simultaneously from hundreds of individual neurons. This will provide a much more detailed view of the underlying neural computations at their fundamental resolution – spikes – and much higher signal-to-noise ratio signals for decoding attempted speech. The project is divided into two research areas. First, we seek to understand how networks of neurons in two closely interacting cortical areas – ventral (speech motor) precentral gyrus (PCG) and superior temporal gyrus (STG) – generate speech. These areas have not previously been recorded from at scale with single neuron resolution and characterizing their dynamics will be critical for designing an effective speech iBCI. We will examine “what” parameters of speech neurons in these two areas encode, and “when” during the preparation and production of speech different neural computations occur. We will apply cutting-edge dynamical systems and “neural population doctrine” analysis approaches to disentangle various components of neural activity (e.g., motoric, sensory feedback, error-processing) that are distributed across neurons. Second, we will apply state-of-the art artificial intelligence (AI) and control theory- inspired iBCI methods to translate the neural activity that accompanies the person’s attempt to speak into words that appear on a computer (“Brain-to-Words”) and directly into sound (“Brain-to-Voice”). Brain-to-Words, in which speech units such as phonemes are decoded from a slightly delayed window of neural activity, is more constrained because the final output is whole words (which could then be spoken by the computer), without the full richness of the person’s voice. However, it allows for powerful AI techniques to be applied to automatically correct for errors based on the known statistics and rules of language. Brain-to-Voice can potentially restore the full expressive range of speech but requires higher accuracy for intelligible real-time voice synthesis. However, we hypothesize that control theory-based iBCI design and the brain’s immense ability to learn motor tasks will lead to high performance. The two project goals work in concert: achieving the most detailed understanding to date of how neural ensembles produce speech will equip us with the insights needed to develop a medical device that allows people to speak again with speed and accuracy approaching that of able-bodied performance.


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2024 ( Subtotal = $0 )
2024	2022	UNIVERSITY OF CALIFORNIA, DAVIS	1850 RESEARCH PARK DR STE 300	DAVIS	CA	95618	YOLO	USA	Trans-NIH Research Support	001	1	9/10/2024	NEW	$0
2024	2022	UNIVERSITY OF CALIFORNIA, DAVIS	1850 RESEARCH PARK DR, STE 300	DAVIS	CA	95618	YOLO	USA	Trans-NIH Research Support	000	1	10/12/2023	NEW	$0
														Subtotal = $0

Issue Date FY: 2022 ( Subtotal = $1,382,019 )
2022	2022	UNIVERSITY OF CALIFORNIA, DAVIS	1850 RESEARCH PARK DR, STE 300	DAVIS	CA	95618	YOLO	USA	Trans-NIH Research Support	000	1	9/1/2022	NEW	$1,382,019
														Subtotal = $1,382,019

Grand Total All Awards = $1,382,019

Top

All Categories

About

Search

Reports

Data Submission

Award Information

Understanding and restoring speech production using an intracortical brain-computer interface

Award Number: DP2DC021055

ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer