Developing Integrated Evaluation Capacity for DSU RISE Programs
PROJECT DESCRIPTION
In response to a call for supplemental funding to support evaluation capacity building within the
NIH student training programs, we are proposing a project, referred to as Integrated Student
Training Evaluation Program (IREP), designed to integrate our U-RISE program evaluation with
the INBRE program evaluation to strengthen and align both efforts, increasing DSU’s evaluation
capacity and sustainability. Although the U-RISE program has an evaluation component, the
resources are not sufficient to integrate INBRE evaluation tools and processes into the DSU
evaluation process nor is the current evaluation effort sustainable.
The proposed evaluation integration process will include three phases. Phase 1 will be a four-
month planning and development process in which an integrated mixed methods evaluation
process and tools will be created. The INBRE Director of Evaluation, the ISTEP graduate
student, and the ISTEP Project Director will share evaluation tools and processes and develop
an integrated evaluation plan. Phase 2 is a four-month period of piloting the tools and
processes. During this phase the ISTEP Project Director will train the graduate student on
piloting procedures. The evaluation tools and processes will be reviewed by U-RISE staff and
mentors and their feedback and suggestions will guide finalization. The data collected during the
piloting phase will be used to evaluate the current U-RISE program. The ISTEP Project Director
and graduate student will work with the U-RISE program staff to create a program improvement
plan based on the evaluation findings, establishing an actionable feedback process.The final
phase, Phase 3, is four-month process of revising and finalizing tools and processes and
developing procedural manuals. Processes to seamlessly integrate the U-RISE evaluation and
reporting requirements will be described and mechanisms to sustain the evaluation processes
will be established. An internal data sharing process will be established so that the robust data
produced through the ISTEP process continues to be shared at the faculty, department,
College, and institutional levels. During Phase 3 the ISTEP process will be assessed to
determine effectiveness. A summative evaluation of ISTEP goals will be conducted and will
include evidence to support the assessment of each goal.
The process established in this project will be maintained as part of the Center for
Neighborhood Revitalization and Research responsibility to increase meaningful research
opportunities for undergraduate and graduate students. Annually, the CNRR will recruit, train,
and supervise a graduate student to conduct the DSU RISE program evaluations. The CNRR
Director, also the proposed ISTEP Project Director, will continue to serve as liaison to the
INBRE Evaluation to ensure data sharing and evaluation alignment. Information about the
process to create an integrated evaluation model, impact of the model, and how to develop an
integrated evaluation model will be disseminated through peer reviewed journals and practice
journals and at professional meetings and conferences.
The proposed effort will benefit the U-RISE program by creating a comprehensive, robust
evaluation strategy that aligns seamlessly and directly with the INBRE program and with
university assessment requirements. It will benefit the University by providing more accurate
and detailed student success data as well as provide a model to systematically assess student
achievements, success, and graduate school pipeline. Finally, it will benefit INBRE by providing
more robust information about the training program and by providing an integrated evaluation
model to replicate with other network institutions.