Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( 🔒 ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Need Help

Verbal and Non-Verbal Predictors of Successful Communication Within and Across Neurotype: Leveraging Context-Dependent, Next-Generation Digital Phenotyping

Award Number: R01DC023554
ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 05/15/2026
PERIOD OF PERFORMANCE END DATE: 04/30/2031

Group Awards By:

View Award Description

Verbal and Non-Verbal Predictors of Successful Communication Within and Across Neurotype: Leveraging Context-Dependent, Next-Generation Digital Phenotyping - ABSTRACT Conversation is a dynamic interplay between what you say and how you say it, including what your face and voice express. Even autistic individuals who score within the typical range on standardized language tests frequently report less successful and satisfying social communication outcomes than non-autistic peers, which may be related to differences in the integration and use of verbal and non-verbal expressions. Unfortunately, research mostly fails to consider language in its interactional and multi-modal context in two crucial ways: 1) The intra-speaker alignment of language and non-verbal information from facial and vocal expressions of each speaker, and 2) the between-speaker synchrony of verbal and non-verbal features. This represents a major impediment to our understanding of autistic communication. This project takes an innovative approach to analyzing how the integration of verbal and non-verbal cues predict communicative success in 560 autistic and non-autistic youth during peer-to-peer Zoom conversations. A key strength of our plan is to analyze novel facial and vocal behaviors in conjunction with language measures from an ongoing study of the same youth during neurotype-concordant and neurotype-discordant conversations. We propose to leverage multiple techniques, the unique combined expertise of this team, and access to a rich, video-based conversational dataset, to determine how verbal and non-verbal elements together predict self-reported conversational success and satisfaction in autistic and non-autistic adolescents. Three key strengths contribute to our project’s feasibility: 1) Expertise in manual coding of intra-speaker verbal and non-verbal conversational alignment that captures socially relevant details (MPI Grossman); 2) Expertise in computer vision-driven, between-speaker multi-modal synchrony using large scale datasets (MPI Herrington); 3) Access to conversational outcomes measures based on a video dataset of 560 autistic and non-autistic adolescents from an ongoing NIH-funded grant (R01 DC021564-01, Ready to CONNECT: Conversation and Language in Autistic Teens, Dr. Grossman, Co-I). The CONNECT grant captures videos of Zoom conversations between neurotype-matched and -discordant adolescents and includes self-reported measures of participants’ conversational satisfaction. However, the CONNECT project will analyze only verbal predictors of communicative success and satisfaction. The present proposal will exploit this rich video dataset to analyze non-verbal and verbal conversational behavior jointly. We will use cutting-edge computer vision techniques to determine the relative contributions of verbal and non-verbal behaviors, as well as derive network models of nuanced individual communication profiles that can inform more individualized intervention models. The CONNECT team supports this proposal (see letters of support) and both MPIs Herrington and Grossman have full data access and associated IRB approvals. This project represents a huge economy of scale and has the capacity to identify “subgroups and subpopulations” within autism to support individualized interventions (NIDCD’s Strategic Plan Theme 3).


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2026 ( Subtotal = $717,468 )
2026	2026	THE CHILDREN'S HOSPITAL OF PHILADELPHIA	3401 CIVIC CENTER BLVD	PHILADELPHIA	PA	19104	PHILADELPHIA	USA	Research Related to Deafness and Communication Disorders	000	1	5/18/2026	NEW	$717,468
														Subtotal = $717,468

Grand Total All Awards = $717,468

Top

All Categories

About

Search

Reports

Data Submission

Award Information

Verbal and Non-Verbal Predictors of Successful Communication Within and Across Neurotype: Leveraging Context-Dependent, Next-Generation Digital Phenotyping

Award Number: R01DC023554

ORGANIZATION: NATIONAL INSTITUTE ON DEAFNESS AND OTHER COMMUNICATION DISORDERS

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 05/15/2026

PERIOD OF PERFORMANCE END DATE: 04/30/2031

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer