Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( 🔒 ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Need Help

Enhancing the International Brain Laboratory's Video Processing Pipeline with Advanced Pose Estimation and Action Segmentation Tools

Award Number: R50NS145433
ORGANIZATION: NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 08/06/2025
PERIOD OF PERFORMANCE END DATE: 06/30/2028

Group Awards By:

View Award Description

Enhancing the International Brain Laboratory's Video Processing Pipeline with Advanced Pose Estimation and Action Segmentation Tools - Project summary/abstract The International Brain Laboratory (IBL) U19 research program aims to understand how internal states influence decisions and identify their underlying neural mechanisms in mice. Achieving this goal critically depends on the rigorous and robust characterization of behavioral states. The IBL employs a modular video processing pipeline that extracts pose estimates (estimates of the positions of body parts in space) and motion energy information, and incorporates advanced features like diagnostic plots served back to users via a centralized dashboard, a versioning system to track model updates, and the flexibility to run on heterogeneous compute resources. While this robust and scalable infrastructure is state-of-the-art, the individual modules within the pipeline must be updated to improve accuracy and handle the growing diversity of the video data, which currently limits detailed behavioral analysis across studies. To address this, I will modernize the video processing pipeline by incorporating cutting-edge methods: replacing DeepLabCut with Lightning Pose for more accurate 2D pose estimation, integrating 3D pose estimation for precise tracking of paw movements using Anipose, and implementing state-of-the-art action segmentation on both 2D and 3D poses to provide richer behavioral outputs. Each new output will be integrated into existing pipelines for brainwide encoding and decoding models, ensuring that researchers have access to effective tools for linking these new behavioral descriptions to neural activity. By updating and integrating these tools into the IBL’s scalable and flexible infrastructure, this effort will support the U19 research program and advance behavioral analysis across the IBL network and the broader scientific community.


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2026 ( Subtotal = $154,308 )
2026	2026	THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK	615 W 131ST ST	NEW YORK	NY	10027	NEW YORK	USA	Extramural Research Programs in the Neurosciences and Neurological Disorders	000	2	6/19/2026	NON-COMPETING CONTINUATION	$154,308
														Subtotal = $154,308

Issue Date FY: 2025 ( Subtotal = $154,308 )
2025	2025	THE TRUSTEES OF COLUMBIA UNIVERSITY IN THE CITY OF NEW YORK	615 W 131ST ST	NEW YORK	NY	10027	NEW YORK	USA	Extramural Research Programs in the Neurosciences and Neurological Disorders	000	1	8/6/2025	NEW	$154,308
														Subtotal = $154,308

Grand Total All Awards = $308,616

Top

All Categories

About

Search

Reports

Data Submission

Award Information

Enhancing the International Brain Laboratory's Video Processing Pipeline with Advanced Pose Estimation and Action Segmentation Tools

Award Number: R50NS145433

ORGANIZATION: NATIONAL INSTITUTE OF NEUROLOGICAL DISORDERS AND STROKE

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 08/06/2025

PERIOD OF PERFORMANCE END DATE: 06/30/2028

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer