Thursday, July 3, 2025 7/3/2025

A virtual vocal tract for speech output using non-invasive brain-computer interface

Award Number: R01DC016343
ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 07/16/2018
PERIOD OF PERFORMANCE END DATE: 06/30/2025

Group Awards By:

View Award Description

A virtual vocal tract for speech output using non-invasive brain-computer interface - Brain-computer interfaces (BCIs) have the potential to aid the restoration and rehabilitation of movement and communication for individuals with profound neuromotor impairments, including loss of speech. The current therapeutic paradigm for communication BCIs focuses on typing or spelling interfaces, which satisfy an immediate need for those who are not able to use other assistive technology for communication. Many users of BCI; however, desire an additional option to restore fluent vocal production beyond the capabilities of current BCI spellers. An alternative, complementary approach to communication BCIs envisions their potential as a replacement for the human vocal tract. The scientific foundation for a brain-controlled virtual vocal tract has been building in recent years from neuroscience studies of speech production, development of silent speech devices, and improvements to speech synthesizer technology. Our recent study proved the feasibility of a BCI-controlled speech synthesizer, though it was limited to the production of vowel sounds. There is now sufficient evidence and technology to bridge the gap between these past approaches toward a more complete BCI device that can continuously produce both vowels and consonants. The production of both types of phonemes is critical for building consonant-vowel pairs (e.g., syllables), words, and sentences through practice in a process similar speech development in young children. Importantly, the use of a replacement virtual vocal tract BCI depends on one's ability to learn new speech motor skills, which is not immediately clear for individuals with severe neuromotor impairments with dysarthria or anarthria. The goal of this study is to determine whether individuals with neuromotor impairments can learn new speech motor skills using a brain-controlled virtual vocal tract despite severe speech motor dysfunction. To address this goal, nine adults with severe speech intelligibility deficits due to progressive (e.g., amyotrophic lateral sclerosis) and non-progressive (e.g., brainstem stroke) neuromotor dysfunction, as well as 18 age and sex- matched control participants, will be trained to operate a virtual vocal tract BCI. The aims of the proposed study are: (Aim 1) to determine whether participants are able to learn new speech motor skills for accurate production of speech movements (including syllables) using a BCI virtual vocal tract, and (Aim 2) to use the N100 event-related potential suppression response to determine whether the functional network of brain regions needed for speech motor control is still intact and active, particularly for participants with neuromotor impairments. The results of this research will challenge and update current theories of speech motor control in individuals with neuromotor impairments and improve on the design and implementation of BCIs for controlling speech synthesizers in real- time. Both goals advance the long-term goal of a neural prosthesis for restoration of speech capable of providing continuous auditory output for individuals with severe speech impairment. This long-term goal has specific clinical relevance to individuals with severe neuromotor disorders and / or paralysis (e.g., locked-in syndrome) and has the potential to improve patients' quality of life and allow them to better engage in social interactions.


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2024 ( Subtotal = $0 )
2024	2022	UNIVERSITY OF KANSAS CENTER FOR RESEARCH INC	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	5	7/2/2024	NON-COMPETING CONTINUATION	$0
														Subtotal = $0

Issue Date FY: 2022 ( Subtotal = $363,365 )
2022	2022	UNIVERSITY OF KANSAS CENTER FOR RESEARCH, INC.	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	5	6/8/2022	NON-COMPETING CONTINUATION	$363,365
														Subtotal = $363,365

Issue Date FY: 2021 ( Subtotal = $364,720 )
2021	2021	UNIVERSITY OF KANSAS CENTER FOR RESEARCH, INC.	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	4	6/17/2021	NON-COMPETING CONTINUATION	$364,720
														Subtotal = $364,720

Issue Date FY: 2020 ( Subtotal = $364,555 )
2020	2020	UNIVERSITY OF KANSAS CENTER FOR RESEARCH, INC.	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	3	6/26/2020	NON-COMPETING CONTINUATION	$364,555
														Subtotal = $364,555

Issue Date FY: 2019 ( Subtotal = $369,902 )
2019	2019	UNIVERSITY OF KANSAS CENTER FOR RESEARCH, INC.	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	2	6/18/2019	NON-COMPETING CONTINUATION	$369,902
														Subtotal = $369,902

Issue Date FY: 2018 ( Subtotal = $374,422 )
2018	2018	UNIVERSITY OF KANSAS CENTER FOR RESEARCH, INC.	2385 IRVING HILL RD	LAWRENCE	KS	66045	DOUGLAS	USA	Research Related to Deafness and Communication Disorders	000	1	7/15/2018	NEW	$374,422
														Subtotal = $374,422

Grand Total All Awards = $1,836,964

Top

All Categories

About

Search

Reports

Data Submission

Award Information

A virtual vocal tract for speech output using non-invasive brain-computer interface

Award Number: R01DC016343

ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 07/16/2018

PERIOD OF PERFORMANCE END DATE: 06/30/2025

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer