Session 3:
Project Team Breakout Discussion
What would success look like for this evaluation in 2022-2023 (New Project Teams)?
Establishing strong partnership with program leads
Support for and progress towards data collection plan
Development of logic model linking activities to outcomes
Operational definitions for outcomes
What would success look like for this evaluation in 2022-2023 (Continuing Project Teams)?
Measuring and reporting on impact at multiple levels
Examining sustainability of work moving forward
Focusing on local context
What do you foresee as opportunities for using state-level data for your evaluation project (All Teams)?
Breadth of available data; new data available in near future
Tracking student growth
Overlap across state-funded initiatives; aligning efforts across evaluations
Including other measures/proxy measures beyond test scores (e.g., SEL)
What do you foresee as challenges for using state-level data for your evaluation project (All Teams)?
Availability of specific data elements of interest
Variability across projects (e.g., geography, subject area)
Timeline for detecting program effects; measuring lagging data
Measuring impact at student level
What kind of supports are needed to successfully launch evaluation activities this upcoming year (New Project Teams)?
Building mutual trust and accountability with program leads
Development of logic model with program leads
Management and communication from CCEE/CDE/SBE
Reflecting on what has been accomplished so far, what supports and strategies are needed to continue making progression evaluation deliverables (Continuing Project Teams)?
Digging deeper into student data collection
Planning sustainability goals into the evaluation process
Streamlining data requests to avoid duplication and overburden
What are some common metrics that could be consistent across all evaluations (All Teams)?
Program participation, PD utility, student perceptions of impact, student engagement, student growth, program fidelity, administrator buy-in
Common language; identify areas of shared elements and understanding (e.g., definition of success, rigor, capacity building)
Integrating equity