EXTERNAL EVALUATION

External Evaluation Program

Dr. Lizanne DeStefano leads the external evaluation for the NSF ALL-SPICE Alliance supported by Dr. JD Baker (Chaminade University), who serves as internal evaluation liaison. Dr. DeStefano is Professor of Psychology and Director of CEISMC at Georgia Institute of Technology.

Our evaluation questions are:

(1) Implementation: Is ALL-SPICE on schedule and meeting participation targets?

(2) Effectiveness: Is ALL-SPICE operating effectively and how might it improve?

(3) Impact: What near-term (enrollments, participant demographics, participant satisfaction; learning outcomes; socioemotional outcomes; curriculum development; DS capacity) and longer-term outcomes (academic and career advancement of participants; curriculum and programmatic changes among partner institutions; increased DS capacity across Pacific network, tangible collective impact on Pacific challenges; changes in STEM workforce) are associated with ALL-SPICE participation? What is the value-add of the partnership for stakeholders?

(4) Sustainability: How and to what extent is ALL-SPICE scaling and becoming institutionalized? What barriers exist? To what extent will aspects of the partnership be expanded and sustained beyond NSF funding?

(5) NSF INCLUDES Coordination Hub (ICH) Shared Measures. To what extent does ALL-SPICE integrate ICH Shared Measures into its evaluation and reporting framework?

ALL-SPICE Project Climate Survey

ALL-SPICE team members are invited to complete the project’s Climate Survey. This anonymous survey examines:

  • General perception and engagement with ALL-SPICE

  • Diversity, Equity and Inclusion

  • Impact and Outcomes

  • Elements of Collective Impact