Friday, July 4, 2025 7/4/2025

A Mobile Game for Domain Adaptation and Deep Learning in Autism Healthcare

Award Number: R01LM013364
ORGANIZATION: NATIONAL LIBRARY OF MEDICINE
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 07/02/2021
PERIOD OF PERFORMANCE END DATE: 03/31/2026

Group Awards By:

View Award Description

A Mobile Game for Domain Adaptation and Deep Learning in Autism Healthcare - Project Summary Neuropsychiatric disorders are the single greatest cause of disability due to non-communicable disease worldwide, accounting for 14% of the global burden of disease. The current standards of care suffer from subjectivity, inconsistent delivery, and limited access with growing waitlists. New informatics solutions, in particular artificial intelligence (AI) that can port to more ubiquitous mobile health devices and that are not restricted for use in clinical settings, have great potential to complement or even replace aspects of the standards of care. We propose to develop a novel informatics solution for one of the most pressing mental health burdens, autism, which is up in incidence by more than 600% since 1990, among the fastest growing pediatric concerns today, and highly representative of many other neuropsychiatric conditions. We have invented a prototype mobile system called Guess What (guesswhat.stanford.edu) (GW) that turns the focus of the camera on the child through a fluid social engagement with his/her social partner that reinforces prosocial learning while simultaneously measuring the child’s developmental learning progress. At its simplest level, the GW app challenges the child to imitate social and emotion-centric prompts shown on the screen of a smartphone held just above the eyes of the individual with whom the child is playing. But more, as a home-based repeat-use system, GW uses computer vision algorithms and emotion classifiers integrated into gameplay to detect emotion in the child’s face via the phone’s front camera, automatically finding agreement with the displayed prompt, while capturing features such as gaze, eye contact, and joint attention. Preliminary work with more than 20 autistic children resulted in positive user feedback, evidence of high engagement for both the parents and children, and importantly, evidence of clinically meaningful gains in socialization. A single session produces 90 seconds of enriched social video and sensor data, opening up an exciting opportunity for the game play itself to passively generate labeled computer vision libraries that enable the development of better models with higher diagnostic precision going forward. Our proposed project will show that GW can (a.) serve as a mobile therapy that can be used repeatedly by families to target core deficits of autism while inherently tracking progress during use, and, (b.) serve as a distributed system to crowdsource the acquisition of new labeled image libraries for AI models that can automatically classify diagnostic features relevant to autism and extend to other sectors of mental health (and even beyond).


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2025 ( Subtotal = $606,289 )
2025	2025	THE LELAND STANFORD JUNIOR UNIVERSITY	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	000	5	3/14/2025	NON-COMPETING CONTINUATION	$545,660
2025	2025	THE LELAND STANFORD JUNIOR UNIVERSITY	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	001	5	6/26/2025	NON-COMPETING CONTINUATION	$60,629
														Subtotal = $606,289

Issue Date FY: 2024 ( Subtotal = $620,518 )
2024	2024	THE LELAND STANFORD JUNIOR UNIVERSITY	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	001	4	5/8/2024	NON-COMPETING CONTINUATION	$62,052
2024	2024	THE LELAND STANFORD JUNIOR UNIVERSITY	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	000	4	3/11/2024	NON-COMPETING CONTINUATION	$558,466
														Subtotal = $620,518

Issue Date FY: 2023 ( Subtotal = $636,951 )
2023	2023	THE LELAND STANFORD JUNIOR UNIVERSITY	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	000	3	5/3/2023	NON-COMPETING CONTINUATION	$636,951
														Subtotal = $636,951

Issue Date FY: 2022 ( Subtotal = $652,347 )
2022	2022	LELAND STANFORD JUNIOR UNIVERSITY, THE	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	000	2	3/23/2022	NON-COMPETING CONTINUATION	$652,347
														Subtotal = $652,347

Issue Date FY: 2021 ( Subtotal = $667,434 )
2021	2021	LELAND STANFORD JUNIOR UNIVERSITY, THE	450 JANE STANFORD WAY	STANFORD	CA	94305	SANTA CLARA	USA	Medical Library Assistance	000	1	7/2/2021	NEW	$667,434
														Subtotal = $667,434

Grand Total All Awards = $3,183,539

Top

All Categories

About

Search

Reports

Data Submission

Award Information

A Mobile Game for Domain Adaptation and Deep Learning in Autism Healthcare

Award Number: R01LM013364

ORGANIZATION: NATIONAL LIBRARY OF MEDICINE

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 07/02/2021

PERIOD OF PERFORMANCE END DATE: 03/31/2026

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer