Program evaluation and trainee assessment are crucial to support successful training programs
in the biomedical sciences. The updated NIGMS T32 funding mechanism identifies the critical
role of trainee-focused learning goals, aligned activities, effective evaluation and feedback in
advancing current approaches to graduate student training. Yet few training programs are
prepared to integrate evaluation into their programs and incorporate trainee-centered cycles of
improvement. We propose to develop a series of interactive content and video modules on
program evaluation that can be used synchronously or asynchronously to train faculty and lead
administrators in the biomedical sciences in effective and equitable evaluation of training
programs. We further propose to test our content in five institutions, including an HBCU, with
project-trained facilitators leading local learning communities. We will train (and pay) facilitators
at these five institutions to lead teams of training grant PI/PDs and administrators in learning
through a learning community model. The modules will build upon a set of pilot videos and
workshops on program evaluation that were developed and piloted successfully 2020-2021 with
funds from an NIH supplement to NIH 3T32GM008449-27S1 (Leonard, PI) Developing Capacity
to Evaluate Training Programs via Development of Human, Institutional and Social Capital. The
proposed modules will 1) include both introductory and advanced content about evaluation (e.g.
direct measures of trainee performance, principles of equitable evaluation, survey design, focus
group design), 2) set participants up for success by preparing them to identify and work with
evaluators, evaluation advisory boards, and cycles of improvement and 3) address issues and
concerns that are unique to evaluation of training programs in the biomedical sciences. Finally,
we will disseminate modules, facilitation training, and facilitation guides nationally.