Saturday, August 16, 2025 8/16/2025

Dynamics of Multisensory Cue Integration

Award Number: R01EY008266
ORGANIZATION: NATIONAL EYE INSTITUTE
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 08/01/1989
PERIOD OF PERFORMANCE END DATE: 06/30/2028

Group Awards By:

View Award Description

Dynamics of Multisensory Cue Integration - Project Summary To optimally estimate properties of the environment, one should use all available sensory and prior infor- mation. Sensory input arises from multiple sensory modalities, and is uncertain due to physical and neural noise. An ideal observer must combine all cues, taking into account cue reliability and considering alternative causes for discrepancies between cues such as inferring that they derive from different objects (i.e., separate causes) or that one or both sense modalities are miscalibrated. Human behavior is often consistent with “opti- mal” cue integration defined as maximizing combined-cue reliability. Can observers access internal estimates of reliability for confidence judgments to inform subsequent behavior? What computations does the brain use to solve these problems and how do they unfold over time? We tackle these questions by combining computational theory and behavioral experiments to elucidate the dynamics and time course of multisensory cue integration. The standard framework for understanding sensory integration incorporates five key components: (1) reliability-based cue weighting, (2) integration of prior infor- mation, (3) causal inference, (4) cross-modal recalibration and (5) confidence in the sensory estimates. Past work on multisensory cue integration has primarily dealt with situations that are static, but the world is dynamic and ever-changing, many activities (locomotion, driving, sports, etc.) depend critically on combining information over time and on temporal estimates, and sensory cue integration unfolds over time. In Aim 1, we will develop and test models of multisensory temporal perception, both for relative timing and perception of duration as well as understanding how spatial and temporal correlation jointly contribute to causal inference. In Aim 2 we look at sensory-motor integration from a similar perspective: the planning and execution of movement also involves multisensory integration prior to, during, and after a movement, both for movement itself and for judgments about movement success. Finally, in Aim 3 we look at the use of multiple visual and other sensory cues for perception of heading and object motion from optic flow and other cues. We will study whether the five compo- nents of multisensory integration help us to better understand the analysis of optic flow over time, and integrat- ing optic flow with natural self-motion in a virtual environment, for the estimation of heading and detection of moving objects. These studies will shed light on the dynamic processes used to combine sensory information to form a co- herent percept, the unfolding of sensory integration as perceptual decisions are made, and how our senses guide us in an ever-changing world. A better understanding of the dynamics of these processes will inform fu- ture studies on the neural implementation of these computations. These experiments on healthy humans will provide a starting point for understanding multisensory perception in individuals in which these systems are compromised by conditions that impact sensory input (e.g., amblyopia, macular degeneration, stroke).


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2025 ( Subtotal = $393,418 )
2025	2025	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	002	33	7/17/2025	NON-COMPETING CONTINUATION	$393,418
2025	2024	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	001	32	3/20/2025	COMPETING CONTINUATION	$15,078
2025	2022	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	31	3/20/2025	NON-COMPETING CONTINUATION	-$15,078
														Subtotal = $393,418

Issue Date FY: 2024 ( Subtotal = $393,725 )
2024	2024	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	001	32	6/17/2024	COMPETING CONTINUATION	$393,725
2024	2022	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	31	6/13/2024	NON-COMPETING CONTINUATION	$0
														Subtotal = $393,725

Issue Date FY: 2022 ( Subtotal = $375,341 )
2022	2022	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	31	9/8/2022	NON-COMPETING CONTINUATION	$375,341
														Subtotal = $375,341

Issue Date FY: 2021 ( Subtotal = $375,561 )
2021	2021	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	30	9/2/2021	NON-COMPETING CONTINUATION	$375,561
														Subtotal = $375,561

Issue Date FY: 2020 ( Subtotal = $387,398 )
2020	2020	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	002	29	8/25/2020	NON-COMPETING CONTINUATION	$387,398
2020	2019	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	001	28	1/27/2020	COMPETING CONTINUATION	$463
2020	2017	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	27	1/27/2020	NON-COMPETING CONTINUATION	-$463
														Subtotal = $387,398

Issue Date FY: 2019 ( Subtotal = $366,806 )
2019	2019	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	002	28	8/15/2019	COMPETING CONTINUATION	$366,806
2019	2017	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	001	27	8/12/2019	NON-COMPETING CONTINUATION	$0
2019	2017	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	27	11/19/2018	NON-COMPETING CONTINUATION	$0
														Subtotal = $366,806

Issue Date FY: 2017 ( Subtotal = $348,527 )
2017	2017	NEW YORK UNIVERSITY	70 WASHINGTON SQ S	NEW YORK	NY	10012	NEW YORK	USA	Vision Research	000	27	9/7/2017	NON-COMPETING CONTINUATION	$348,527
														Subtotal = $348,527

Issue Date FY: 2016 ( Subtotal = $348,725 )
2016	2016	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	26	8/24/2016	NON-COMPETING CONTINUATION	$348,725
														Subtotal = $348,725

Issue Date FY: 2015 ( Subtotal = $348,917 )
2015	2015	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	001	25	9/15/2015	COMPETING CONTINUATION	$348,917
2015	2014	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	24	9/7/2015	NON-COMPETING CONTINUATION	$0
														Subtotal = $348,917

Issue Date FY: 2014 ( Subtotal = $295,459 )
2014	2014	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	24	5/1/2014	NON-COMPETING CONTINUATION	$295,459
														Subtotal = $295,459

Issue Date FY: 2013 ( Subtotal = $286,414 )
2013	2013	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	001	23	6/25/2013	NON-COMPETING CONTINUATION	$15,074
2013	2013	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	23	5/2/2013	NON-COMPETING CONTINUATION	$271,340
														Subtotal = $286,414

Issue Date FY: 2012 ( Subtotal = $301,489 )
2012	2012	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	001	22	4/20/2012	COMPETING CONTINUATION	$301,489
2012	2010	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	21	4/18/2012	NON-COMPETING CONTINUATION	$0
														Subtotal = $301,489

Issue Date FY: 2010 ( Subtotal = $298,544 )
2010	2010	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	21	6/30/2010	NON-COMPETING CONTINUATION	$298,544
														Subtotal = $298,544

Issue Date FY: 2009 ( Subtotal = $301,747 )
2009	2009	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	20	6/15/2009	NON-COMPETING CONTINUATION	$301,747
														Subtotal = $301,747

Issue Date FY: 2008 ( Subtotal = $318,685 )
2008	2008	NEW YORK UNIVERSITY	SPONSORED PGMS ACCOUNTING	NEW YORK	NY	10003	NEW YORK	USA	Vision Research	000	19	5/21/2008	COMPETING CONTINUATION	$318,685
														Subtotal = $318,685

Issue Date FY: 2007 ( Subtotal = $291,517 )
2007	2007	NEW YORK UNIVERSITY	726 BROADWAY, 2ND FL ROOM 271	NEW YORK-NEW YORK	NY	10003		USA	Vision Research	000	18	5/25/2007	NON-COMPETING CONTINUATION	$291,517
														Subtotal = $291,517

Issue Date FY: 2006 ( Subtotal = $293,324 )
2006	2006	NEW YORK UNIVERSITY	726 BROADWAY, 2ND FL ROOM 271	NEW YORK-NEW YORK	NY	10003		USA	Vision Research	000	17	6/19/2006	NON-COMPETING CONTINUATION	$293,324
														Subtotal = $293,324

Issue Date FY: 2005 ( Subtotal = $300,546 )
2005	2005	NEW YORK UNIVERSITY	726 BROADWAY, 2ND FL ROOM 271	NEW YORK-NEW YORK	NY	10003		USA	Vision Research	000	16	7/15/2005	NON-COMPETING CONTINUATION	$300,546
														Subtotal = $300,546

Issue Date FY: 2004 ( Subtotal = $300,705 )
2004	2004	NEW YORK UNIVERSITY	726 BROADWAY, 2ND FL ROOM 271	NEW YORK-NEW YORK	NY	10003		USA	Vision Research	000	15	7/29/2004	COMPETING CONTINUATION	$300,705
														Subtotal = $300,705

Issue Date FY: 2003 ( Subtotal = $261,787 )
2003	2003	NEW YORK UNIVERSITY	726 BROADWAY, 2ND FL ROOM 271	NEW YORK-NEW YORK	NY	10003		USA	Vision Research	000	14	6/20/2003	NON-COMPETING CONTINUATION	$261,787
														Subtotal = $261,787

Grand Total All Awards = $7,680,163

Page 1 of 2 (60 items)12

Top

All Categories

About

Search

Reports

Data Submission

Award Information

Dynamics of Multisensory Cue Integration

Award Number: R01EY008266

ORGANIZATION: NATIONAL EYE INSTITUTE

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 08/01/1989

PERIOD OF PERFORMANCE END DATE: 06/30/2028

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer