CEC Publications

From the DPC Coordination and Evaluation Center at UCLA

CEC publications on this page include:

  • Special Issue: Evaluating a National Biomedical Diversity Initiative
  • “Moving the Science Forward”: Faculty Perceptions of Culturally Diverse Mentor Training Benefits, Challenges, and Support
  • Mentoring Experiences and Publication Productivity Among Early Career Biomedical Investigators and Trainees
  • A Cross-Case Analysis of Developing Program Sustainability and Institutionalization in Early Stages of a Multisite Biomedical Student Diversity Initiative
  • Examining the Impact of the BUilding Infrastructure Leading to Diversity (BUILD) Initiative on Academic and Researcher Self-Efficacy among First Year Students
  • Interventions to Optimize Mentoring Relationships for Diverse Biomedical Researchers
  • Development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) Scale
  • A Participatory Approach to Evaluating a National Training and Institutional Change Initiative: The BUILD Longitudinal Evaluation
  • Advancing Inclusive Science and Systemic Change: The Convergence of National Aims and Institutional Goals in Implementing and Assessing Biomedical Science Training
  • Baseline Characteristics of the 2015-2019 First Year Student Cohorts of the NIH Building Infrastructure Leading to Diversity (BUILD) Program in Ethnicity & Disease *NEW*
  • Evaluating Efforts to Diversify the Biomedical Workforce: The Role and Function of the Coordination and Evaluation Center of the Diversity Program Consortium
  • Using Collaborative Approaches with a Multi-method, Multi-site, Multi-target Intervention: Evaluating the National Research Mentoring Network

Special Issue: Evaluating a National Biomedical Diversity Initiative

Summary
  • Editors’ notes by Lourdes Guerrero, Christina Christie
  • Understanding the context and appreciating the complexity of evaluating the Diversity Program Consortium by Lourdes R. Guerrero, Teresa Seeman, Heather McCreath, Nicole M.G. Maccalla, Keith C. Norris
  • Implementing case study design to evaluate diverse institutions and STEM education contexts: Lessons and key areas for systematic study by Krystle P. Cobian, Damani Khary White-Lewis, Sylvia Hurtado, Hector V. Ramos
  • Describing engagement practices for the Enhance Diversity Study using principles of Tailored Panel Management by Karina D. Ramirez, Cynthia J. Joseph, Hansook Oh
  • A meta-analysis approach for evaluating the effectiveness of complex multisite programs by Catherine M. Crespi, Krystle P. Cobian
  • Gauging treatment impact: The development of exposure variables in a large-scale evaluation study by Nicole M. G. Maccalla, Dawn Purnell, Heather E. McCreath, Robert A. Dennis, Teresa Seeman
  • Theoretical and conceptual frameworks across local evaluation efforts in a nationwide consortium by Christina A. Christie, Carmel R. Wright
  • Advice from local/site evaluators: How to manage “up” within a large-scale initiative by Melanie Hwalek, Matt Honoré, Shavonnea Brown
  • Large-scale evaluation efforts and their implications for the field by Tarek Azzam
  • The funders’ perspective: Lessons learned from the National Institutes of Health Diversity Program Consortium evaluation by Kenneth D. Gibbs Jr., Christa Reynolds, Sabrina Epou, Alison Gammie

View Full Text

“Moving the Science Forward”: Faculty Perceptions of Culturally Diverse Mentor Training Benefits, Challenges, and Support

Summary

There is a pressing need for deeper cultural awareness among postsecondary faculty, yet few studies focus on institutions with developing research infrastructure, which enroll large proportions of racially minoritized students. Using social exchange theory, we inves- tigate faculty members’ perceptions of “culturally diverse mentor training,” which includes culturally aware mentor (CAM) training, Entering Mentoring, and self-designed mentor training initiatives.

Download PDF

Mentoring Experiences and Publication Productivity Among Early Career Biomedical Investigators and Trainees

Summary

Underrepresented racial and eth- nic minorities (URMs) are less likely to graduate from high school, attend college and major in biomedical sci- ences, and obtain doctoral degrees than non-Hispanic Whites. Persis- tent educational disparities occur across the lifecourse and extend be- yond academic preparation pathways and into career trajectories. African Americans/Blacks, Latinos/Latinas, American Indians or Alaska Natives, Native Hawaiians, and other Pacific Islanders are URMs in the biomedical sciences, while non-Hispanic Whites and Asians are well-represented groups (WRGs) in the biomedical sciences.

Download PDF

A Cross-Case Analysis of Developing Program Sustainability and Institutionalization in Early Stages of a Multisite Biomedical Student Diversity Initiative

Summary

Grant funding often drives innovative programming in efforts to enhance diversity in biomedical fields, yet strategies for sustainability of grant-funded biomedical intervention are not well understood. Additionally, as funding agencies shift toward supporting institutional change to biomedical training, less is known about the extent to which sustainability strategies can support long-term institutionalization of the original goals of the grant- funded initiative. The purpose of this study is twofold: to identify strategies used by grant-funded programs for promoting sustainability, and to examine the interrelations between the concepts of sustainability and institutionalization during early stages of grant-funded biomedical career training efforts.

Download PDF

Examining the Impact of the BUilding Infrastructure Leading to Diversity (BUILD) Initiative on Academic and Researcher Self-Efficacy among First Year Students

Summary

Stemming from Albert Bandura’s work on self-efficacy (1977) and later work on social cognitive theory (Bandura, 1991), self-efficacy was developed to explain how people think, motivate themselves, and ultimately how they behave - including how long they will persist in the face of obstacles or challenging situations (Bandura & Adams, 1977).

Download PDF

Interventions to Optimize Mentoring Relationships for Diverse Biomedical Researchers

Summary

The articles in this special issue provide insights from a variety of mentoring interventions that were implemented across the NIH Diversity Program Consortium (DPC). Many of the articles highlight examples of how the Entering Mentoring and Entering Research curricular materials, available through the National Research Mentoring Network (NRMN), were adapted and implemented for research mentors and research trainees at Building Infrastructure Leading to Diversity (BUILD) institutions.

Download PDF

Development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) Scale

Summary

This publication provides an overview of the development of the Self-Efficacy as Faculty Change Agent for Diversity (SE-FCA-D) scale. The 5-item scale recently appeared as an additional module on the Higher Education and Research Institute (HERI) Faculty Survey 2019-2020 for the 10 BUILD programs within the Diversity Program Consortium that are participating in the Enhance Diversity Study, supported by the National Institutes of Health (NIH U54GM119024).

See the Full Text

Download PDF

A Participatory Approach to Evaluating a National Training and Institutional Change Initiative: The BUILD Longitudinal Evaluation

Summary

The National Institutes of Health (NIH) funds training programs to increase the numbers and skills of scientists who obtain NIH research grants, but few programs have been rigorously evaluated. The sizeable recent NIH investment in developing programs to increase the diversity of the NIH-funded workforce, implemented through the Diversity Program Consortium (DPC), is unusual in that it also funds a Consortium-wide evaluation plan, which spans the activities of the 10 BUilding Infrastructure Leading to Diversity (BUILD) awardees and the National Research Mentoring Network (NRMN). The purpose of this article is to describe the evaluation design and innovations of the BUILD Program on students, faculty, and institutions of the 10 primarily undergraduate BUILD sites.

See the Full Text

Download PDF

Advancing Inclusive Science and Systemic Change: The Convergence of National Aims and Institutional Goals in Implementing and Assessing Biomedical Science Training

Summary

National reports call for improving America?s leadership in scientific research, accelerating degree attainments, and diversifying the scientific workforce to foster innovation. However, slow progress and persistent disparities across growing U.S. populations are evident on key science workforce indicators, from degree attainment to career achievements. The purpose of this article is to provide a conceptual basis and overview of a national effort funded by the National Institutes of Health (NIH) that advances inclusive science practice and systemic change. We introduce the context, features, and rationale that drive practice and evaluation in the Diversity Program Consortium (DPC) approach, which is an experimental program to implement and evaluate evidence-based and novel practices to expand and diversify the biomedical workforce.

See the Full Text

Download PDF

Baseline Characteristics of the 2015-2019 First Year Student Cohorts of the NIH Building Infrastructure Leading to Diversity (BUILD) Program in Ethnicity & Disease

Summary

The biomedical/behavioral sciences lag in the recruitment and ad­vancement of students from historically underrepresented backgrounds. In 2014 the NIH created the Diversity Program Consortium (DPC), a prospective, multi-site study comprising 10 Building Infrastructure Leading to Diversity (BUILD) institutional grantees, the National Research Mentor­ing Network (NRMN) and a Coordination and Evaluation Center (CEC). This article describes baseline characteristics of four incoming, first-year student cohorts at the primary BUILD institutions who completed the Higher Education Research Institute, The Freshmen Survey between 2015-2019. These freshmen are the primary student cohorts for longitudinal analyses comparing outcomes of BUILD program participants and non-participants.

See the Full Text

Download PDF

Evaluating Efforts to Diversify the Biomedical Workforce: The Role and Function of the Coordination and Evaluation Center of the Diversity Program Consortium

Summary

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences.

See the Full Text

Download PDF

Using Collaborative Approaches with a Multi-Method, Multi-Site, Multi-Target Intervention: Evaluating the National Research Mentoring Network

Summary

The NIH-funded National Research Mentoring Network (NRMN) aims to increase the representation and success of underrepresented groups (URGs) in biomedical research by enhancing the training and career development of individuals from diverse backgrounds, communities, and cultures. The national scope of NRMN, its wide array of innovative programs in mentor and mentee matching and training across the career spectrum, requires a collaborative evaluation strategy that addresses both internal and external evaluation needs. Due to the variety of programs implemented for each target group, the NRMN program is responsible for its own process and short-term outcome evaluations and the national Coordination and Evaluation Center (CEC) is responsible for assessing the medium and long-term effectiveness of the implemented strategies and program sustainability. Using a collaborative, utilization-focused evaluation framework, both internal NRMN evaluators and the CEC are working to translate findings into information that can be used to make both short term and long-term decisions about the efficacy and reach of the NRMN model. This important information can then inform efforts to institutionalize the current programs and potentially replicate them elsewhere.

See the Full Text

Download PDF

The Diversity Program Consortium Coordination and Evaluation Center at UCLA is supported by Office of the Director of the National Institutes of Health / National Institutes of General Medical Sciences under award number U54GM119024.
Need Assistance? Please contact our support team: info@diversityprogramconsortium.org .