Saturday, July 5, 2025 7/5/2025

DeconDTN: Deconfounding Deep Transformer Networks for Clinical NLP

Award Number: R01LM014056
ORGANIZATION: NATIONAL LIBRARY OF MEDICINE
OPDIV: NIH
AWARD CLASS: DISCRETIONARY
AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)
PERIOD OF PERFORMANCE START DATE: 06/01/2022
PERIOD OF PERFORMANCE END DATE: 02/28/2026

Group Awards By:

View Award Description

DeconDTN: Deconfounding Deep Transformer Networks for Clinical NLP - Natural Language Processing (NLP) methods have been broadly applied to clinical problems, from recognition of clinical findings in physician notes to identification of transcribed speech samples indicating changes in cognitive status. Deep transformer networks (DTNs) have dramatically advanced NLP accuracy. These deep learning models have multiple hidden layers that may correspond to billions of trainable parameters, allowing them to apply information learned from training on large unlabeled corpora to a specific task of interest. However, their size leaves them especially vulnerable to confounding bias, induced by variables that can influence both the predictor (text) and the outcome (e.g. an associated diagnosis) of a predictive model. Such systematic biases are a recognized danger in the application of artificial intelligence methods to clinical problems, and are the focus of NLM NOT-LM-19-003 which invites applications proposing methods to identify and address them. Deep learning models in general require large amounts of training data, spurring initiatives to aggregate medical data from across institutional siloes. This can increase data set size and enhance model portability, but leaves the resulting models vulnerable to confounding by provenance, where models learn to recognize the origin of dataset components and make biased predictions based on site-specific class distributions (e.g. COVID prevalence). Such models will assign classes based on indicators of dataset provenance, rather than diagnostically meaningful linguistic differences, and make erroneous predictions when the provenance-specific distributions at the point of deployment differ from those in the training set. Confounding of this nature is a pervasive problem that presents a fundamental barrier to the portability of trained models, and threatens the utility of datasets assembled from across institutions and services. Unlike traditional statistical and machine learning models, with deep transformer networks feature representations are distributed across parameters spread throughout the entire network. New methods are needed to meet the challenge of identifying and mitigating the influence of confounding variables in such models. In the proposed research we will develop a systematic approach to Deconfounding Deep Transformer Networks (DeconDTN), embodied in an eponymous and publicly available set of open source tools for (1) identification of provenance-related biases, (2) mitigation of these biases using a novel set of validated methods, and (3) systematic evaluation of the resulting effects on model performance. While DeconDTN will be generally applicable, development and evaluation will occur in the context of three use cases involving data sets drawn from different sources: classification of speech transcripts from participants with dementia drawn from two locations, identification of goals-of-care discussions in clinical notes drawn from multiple studies involving a range of clinical services, and prediction of COVID-19 status in notes drawn from different clinical units. Our driving hypothesis is that the resulting models will make more accurate predictions in these heterogenous datasets than corresponding models without correction for confounding by provenance.


Issue Date FY	Funding FY	Legal Entity Name	Legal Entity Address	Legal Entity City	Legal Entity State	Legal Entity Zip Code	Legal Entity COUNTY	Legal Entity COUNTRY	Assistance Listing	Award Code	Budget Year	Action Date	Action Type	Action Amount

Issue Date FY: 2025 ( Subtotal = $311,763 )
2025	2025	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	000	4	2/20/2025	NON-COMPETING CONTINUATION	$311,763
														Subtotal = $311,763

Issue Date FY: 2024 ( Subtotal = $348,541 )
2024	2024	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	000	3	2/28/2024	NON-COMPETING CONTINUATION	$313,687
2024	2024	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	001	3	5/8/2024	NON-COMPETING CONTINUATION	$34,854
														Subtotal = $348,541

Issue Date FY: 2023 ( Subtotal = $653,278 )
2023	2023	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	001	2	5/4/2023	SUPPLEMENT FOR EXPANSION	$311,240
2023	2023	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	000	2	2/2/2023	NON-COMPETING CONTINUATION	$342,038
														Subtotal = $653,278

Issue Date FY: 2022 ( Subtotal = $345,290 )
2022	2022	UNIVERSITY OF WASHINGTON	4333 BROOKLYN AVE NE	SEATTLE	WA	98195	KING	USA	Medical Library Assistance	000	1	5/24/2022	NEW	$345,290
														Subtotal = $345,290

Grand Total All Awards = $1,658,872

Top

All Categories

About

Search

Reports

Data Submission

Award Information

DeconDTN: Deconfounding Deep Transformer Networks for Clinical NLP

Award Number: R01LM014056

ORGANIZATION: NATIONAL LIBRARY OF MEDICINE

OPDIV: NIH

AWARD CLASS: DISCRETIONARY

AWARD ACTIVITY TYPE: SCIENTIFIC/HEALTH RESEARCH (INCLUDES SURVEYS)

PERIOD OF PERFORMANCE START DATE: 06/01/2022

PERIOD OF PERFORMANCE END DATE: 02/28/2026

Federal Websites

Department of Health & Human Services

HHS Operating Divisions

HHS Staff Divisions

Download A Document Viewer