One Voice – One Plan Office of Education Improvement and Innovation MI-CSI: Do Stage Implement Plan and Monitor Plan

Introduction Do Implement Monitor Evaluate

Activity: School Improvement on the Fly gTime/PlanningTime.html

Implementation Fidelity Impact Do Vocabulary

Implement Do Implement Monitor Evaluate

The Big Picture

Nothing to it but to do it? Implementation Process

Readiness to Implement  Have a shared vision?  Understand the need?  Concerns have been addressed?  Staff and administrators are able to integrate this new work with existing work?

Implementation Guide Implementation Guide Essential to implementation Non-negotiableNon-negotiable Highest level of fidelity May vary from gold standard Still true to the research Not consistent with research Will not lead to desired results Key Feature

Sample Strategy Implementation Guide

Strategy: What teachers do in the classroom with the students in the presence of content – Teachers will…. – Math teachers will…. – ELA teachers will… MDE Definition of Strategy

Activity: What needs to be done so that staff or teams – are ready to implement the strategy – have a plan for implementation of the strategy – have a plan to monitor and evaluate the implementation of the strategy and the impact on student achievement MDE Definition of Activity

Matrix 1 Tool

How will we ensure readiness for implementation? How will we ensure that staff and administrators have the knowledge and skills to implement? Professional development around strategy Purchase materials -Planning for implementation – Identify schedule for strategy use, personnel, mechanism for monitoring, rollout, etc. -Communication vehicles Activities: Getting Ready to Implement

How will we ensure successful opportunity for implementation of the strategy? Communication – to whom? How? Ongoing coaching? Observations? Instructional technology utilized?* Activities to support at-risk students (For Title One students)* Parent Involvement has been planned Activities: Implement

How will we ensure the strategy is implemented with fidelity? How will you monitor the program’s impact on student achievement? Walkthroughs PLC/CASL meetings Documentation of effective implementation Documentation of impact (Gather achievement data) Demonstration classrooms or lesson study, videos, self assessments Activities: Monitor Fidelity of Implementation

Monitoring of Activity Implementation

Monitor Do Implement Monitor Evaluate

The Big Picture

Monitoring Adults are implementing the strategy with fidelity Impact implementation is having on students

Leadership and Learning Center 2010 Implementation and Impact

Monitoring Implementation Demographics Student Outcomes Perceptions School Processes Meeting schedules Meeting minutes Ongoing Student Data Walkthrough data

Collected on adult actions or behaviors Based on teacher actions related to set standards – Implementation Guide to define – What does the strategy look like and sound like if implemented fully? Quantifiable Implementation Data

How will we know the strategy is implemented as intended? Have we clearly defined expected adult actions? How well have we communicate these expectations? What data will we collect? – Self-collection – Peer collection – Leader collection Adult Actions

Collected on student learning related to a specific outcome or target A proficiency level should be set based on pre-determined criteria – Examples: 70% is considered proficient 4 out of 6 on rubric Quantifiable Impact Data

How will we know the strategy is impacting what students learn? Have we clearly defined learning expectations? What data will we collect? – Formative – Interim – Summative Student Learning

1.Implementation Guide Sample: Close and Critical Reading 2.Monitoring of Activity Implementation 3.Matrix 1Tool 4.Monitoring of Classroom Strategy Implementation Tools to support Successful Implementation

Monitoring of Classroom Strategy Implementation

What mechanism will we use to determine the interaction between the data collected on adult actions (Implementation data) and student learning (Impact data)? – Format – Frequency – Adjustments Relationship between implementation and impact data

Hey, why did we do that Flipped Activity?

Type of Data: Implementation (Adult Data) versus Impact (Student Data) Fidelity Rate: The percentage of adults implementing the strategy the way it was defined. Data Narrative: A non-judgemental, factual statement about the data. Causal Factors: Factors that led to the fidelity or proficiency rate. Action: The steps that will be taken to improve the fidelity or proficiency rate. Flipped Activity

Strategy Fidelity Rate Percent Proficient Share out

Close and Critical Reading Fidelity Rate 50% Percent Proficient 38% Example Shared:

Fidelity Rate compared to Percent Proficient 50% Fidelity Rate 38% Proficient Fidelity Rate < 80%

Fidelity Rate compared to Percent Proficient 50% Fidelity Rate Two staff members did not received adequate training Three staff members indicated that they forgot to record their strategies. 38% Proficient Fidelity Rate < 80%

We will have a follow up training after school on the 28th from 2:30 - 4:00. All are invited. All staff members have received the link to the walkthrough tool again and deadlines have been reiterated. FOCUS ON Implementation Actions Fidelity Rate < 80%

Close and Critical Reading Fidelity Rate 91% Percent Proficient 73% Another Example :

Fidelity Rate compared to Percent Proficient 91% Fidelity Rate 73% Proficient Fidelity Rate > 80%

Fidelity Rate compared to Percent Proficient 91% Fidelity Rate Teacher who did not implement had a misunderstanding of how to model and scaffold learning for all students. 72% Proficient 20% of students in this grade are not reading at or above grade level. Fidelity Rate > 80%

FOCUS ON actions for both Implementation and Impact Observe Peers Embed Coaching Support with focus on modeling for two weeks. Pull intervention group to support students below grade level. Re-test students using appropriate grade level text. Fidelity Rate < 80%

You decide: SI Plan is a compliance document or SI Plan is a blueprint for increasing student learning in the classroom A SI blueprint will include active participation by staff, ongoing data collection and analysis and discussions around causal factors and deliberate actions to increase fidelity and student learning. So, Where do we go from here?

Conclusion Do Implement Monitor Evaluate