Session 3:
Project Team Breakout Discussion

Thematic Summary of Jamboard Discussion

What would success look like for this evaluation in 2022-2023 (New Project Teams)?

• Establishing strong partnership with program leads

• Support for and progress towards data collection plan

• Development of logic model linking activities to outcomes

• Operational definitions for outcomes 

What would success look like for this evaluation in 2022-2023 (Continuing Project Teams)?

• Measuring and reporting on impact at multiple levels

• Examining sustainability of work moving forward 

• Focusing on local context

What do you foresee as opportunities for using state-level data for your evaluation project (All Teams)? 

• Breadth of available data; new data available in near future

• Tracking student growth 

• Overlap across state-funded initiatives; aligning efforts across evaluations 

• Including other measures/proxy measures beyond test scores (e.g., SEL)

What do you foresee as challenges for using state-level data for your evaluation project (All Teams)? 

• Availability of specific data elements of interest

• Variability across projects (e.g., geography, subject area)

• Timeline for detecting program effects; measuring lagging data

• Measuring impact at student level

What kind of supports are needed to successfully launch evaluation activities this upcoming year (New Project Teams)? 

• Building mutual trust and accountability with program leads

• Development of logic model with program leads 

• Management and communication from CCEE/CDE/SBE

Reflecting on what has been accomplished so far, what supports and strategies are needed to continue making progression evaluation deliverables (Continuing Project Teams)? 

• Digging deeper into student data collection 

• Planning sustainability goals into the evaluation process

• Streamlining data requests to avoid duplication and overburden

What are some common metrics that could be consistent across all evaluations (All Teams)? 

• Program participation, PD utility,  student perceptions of impact, student engagement, student growth, program fidelity, administrator buy-in

• Common language; identify areas of shared elements and understanding (e.g., definition of success, rigor, capacity building)

• Integrating equity