Sunday, July 20, 2025 7/20/2025

Point and Listen: Augmented Reality Interfaces for the Visually Impaired

Award Number: R01EY025332
ORGANIZATION: NATIONAL EYE INSTITUTE
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 03/10/2016
PERIOD OF PERFORMANCE END DATE: 02/28/2026

Group Awards By:

View Award Description

Point and Listen: Augmented Reality Interfaces for the Visually Impaired - Point and Listen: Augmented Reality Interfaces for the Visually Impaired Summary CamIO (“Camera Input-Output”) is a project designed to make physical objects, including documents, maps and 3D objects such as architectural models, fully accessible to people who are blind or visually impaired. It makes these objects accessible by means of an audio-based Augmented Reality (AR) interface: the user points to a specific location on an object of interest and hears audio information about this location read aloud (or sees an enhanced image of the selected location if the user has low vision). Compared with other approaches to making objects accessible to people who are blind or visually impaired, CamIO offers several advantages: (a) there is no need to modify or augment existing objects (e.g., with braille labels or special touch-sensitive buttons), requiring only a smartphone and optional wearable camera device; (b) CamIO is accessible even to those who are not fluent braille readers; and (c) it permits natural exploration of the object with all fingers to enable audio-haptic interactions with the object. Building on our past work on the prototype CamIO iPhone app, we plan to develop powerful enhancements and new functionality, including finger tracking as an alternative to the use of a pointing stylus, and support for wearable options such as the camera-enabled Envision Glasses that will offer a far superior user interface to what is possible with a stand-alone smartphone app. New authoring capabilities will make it easy for blind and visually impaired users and sighted assistants to create audio labels for objects. We will also pursue two exciting applications of CamIO in depth: using CamIO to make tactile maps fully interactive and easier to understand, and the development of interactive installations such as a 3D scale model of a large playground that helps visually impaired playground visitors familiarize themselves with the playground’s layout and features. Finally, people who are blind or visually impaired – the target users of the CamIO system – will be involved in all aspects of the proposed research, to maximize the impact of the research effort.


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2025 ( Subtotal = $438,051 )
2025	2025	THE SMITH-KETTLEWELL EYE RESEARCH INSTITUTE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	8	3/19/2025	NON-COMPETING CONTINUATION	$438,051
														Subtotal = $438,051

Issue Date FY: 2024 ( Subtotal = $435,093 )
2024	2024	THE SMITH-KETTLEWELL EYE RESEARCH INSTITUTE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	001	7	3/1/2024	NON-COMPETING CONTINUATION	$435,093
2024	2023	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	6	10/16/2023	SUPPLEMENT FOR EXPANSION	$0
														Subtotal = $435,093

Issue Date FY: 2023 ( Subtotal = $632,571 )
2023	2023	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	001	6	8/30/2023	SUPPLEMENT FOR EXPANSION	$200,350
2023	2023	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	6	2/13/2023	NON-COMPETING CONTINUATION	$432,221
														Subtotal = $632,571

Issue Date FY: 2022 ( Subtotal = $429,433 )
2022	2022	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	5	8/26/2022	COMPETING CONTINUATION	$429,433
														Subtotal = $429,433

Issue Date FY: 2021 ( Subtotal = -$173 )
2021	2019	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	4	7/23/2021	NON-COMPETING CONTINUATION	-$173
														Subtotal = -$173

Issue Date FY: 2019 ( Subtotal = $416,574 )
2019	2019	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	4	2/14/2019	NON-COMPETING CONTINUATION	$416,574
														Subtotal = $416,574

Issue Date FY: 2018 ( Subtotal = $416,574 )
2018	2018	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	3	2/20/2018	NON-COMPETING CONTINUATION	$374,916
2018	2018	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	001	3	5/22/2018	NON-COMPETING CONTINUATION	$41,658
														Subtotal = $416,574

Issue Date FY: 2017 ( Subtotal = $416,574 )
2017	2017	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	2	2/20/2017	NON-COMPETING CONTINUATION	$374,916
2017	2017	SMITH-KETTLEWELL EYE RESEARCH INSTITUTE, THE	2318 FILLMORE ST	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	001	2	7/24/2017	NON-COMPETING CONTINUATION	$41,658
														Subtotal = $416,574

Issue Date FY: 2016 ( Subtotal = $416,574 )
2016	2016	SMITH-KETTLEWELL EYE RESEARCH FOUNDATION	2318 FILLMORE STREET	SAN FRANCISCO	CA	94115	SAN FRANCISCO	USA	Vision Research	000	1	3/7/2016	NEW	$416,574
														Subtotal = $416,574

Grand Total All Awards = $3,601,271

Top

All Categories

About

Search

Reports

Data Submission

Award Information

Point and Listen: Augmented Reality Interfaces for the Visually Impaired

Award Number: R01EY025332

ORGANIZATION: NATIONAL EYE INSTITUTE

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 03/10/2016

PERIOD OF PERFORMANCE END DATE: 02/28/2026

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer