KEEP And Student Growth Measures for Building Leaders Lawrence School District, May 14, 2014 Bill Bagshaw, Assistant Director, TLA, KSDE Kayeri Akweks, Education Program Consultant TLA, KSDE

Today we will cover: KEEP Building Leader Evaluation Process Using Multiple Student Growth Measures Final Summative Rating KEEP Repository

WAIVER - Principle 3 Supporting Effective Instruction and Leadership Implement teacher and principal evaluation and support systems that: 1. Are used for continual improvement of instruction 2. Use at least 3 performance levels 3. Use multiple measures including student growth as significant factor 4. Are used to evaluate on a regular basis 5. Provide clear, timely, and useful feedback 6. Are used to inform personnel decisions

Building Leader Process

The Constructs and Components Building Leader The constructs to be measured in the evaluation instrument: Construct 1: Setting Direction Construct 2: Developing the Learner Construct 4: Making the Organization Work Construct 3: Developing Staff

Building Leader Rubric Example

Evaluation Goal Selection District Goals Building Goals Individual Goals It is recommended that each Educator selects 2 goals per evaluation cycle: ◦A district ◦or building level goal, ◦A personal goal mutually agreed upon by the Evaluator and the Evaluatee.

Evaluating the Building Leader Thinking through and discussing the Process - readiness per year? Goals Selected Student Growth Measures selected? Timeline for Evaluation? ◦1 Cycle ◦2 Cycles

Inter-Rater Agreement DEFINITION: Reliability refers to the consistency of an assessment. VALIDITY vs. RELIABILITY: Factual vs. Consistent EXPECTATION: School district evaluators attend professional learning activities that address the issue of inter-rater agreement relative to using the KEEP Rubrics. The same expectations apply to districts using an evaluation system other than KEEP.

Inter-rater Agreement Evaluatee Evaluator AEvaluator B Agreement

Using Multiple Student Growth Measures

Multiple Student Growth Measures Kansas State Assessments used as a Student Growth Measure are only required for teachers of tested grades and subjects. Use assessment measures currently in use in your district. Share credit/responsibility for student growth. Time for student growth 1-4 years.

Small Group Activity – Share Measures You Currently Use Get into small groups of 3-4 Talk about the grades, subjects, and measures that you currently use Write these down on the paper/chart Choose a person to report out Report out to the larger group Multiple Measures

Sample Measures for Building Leaders Evaluation Percent of growth of Program- Enrollment/Participation Amount of time engaged with data material online products Anecdotal Notes Artifacts Attendance Data Awards and Accomplishments PE Attendance Career Readiness/Success Rates past Graduation Building test Scores Report Card Data Classroom Observations Performed Climate Surveys Communication of Professional Information Contact Log Discipline Data Dual Credit Course Enrollment Engagement with families Extended Learning Opportunities Graduation Rates Increased # of research-based instructional practices implemented Instructional Coach - # of times in the classroom Involvement in professional organizations # of students involved in extra- curricular activities Number of students who went to college Parent Involvement

Significance Definition The change in student achievement for an individual student between two points in time, determined using multiple measures To include gains and progress toward post- secondary and workforce readiness To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives

17 Multiple Student Growth Measures, Effectiveness, Significance

Evaluations Update As of April 1, 2014, 223 D2 Assurance Online Forms have been submitted. All D2 Assurance Online Forms were due on March 1, Please continue to complete. By July 31, 2014, all evaluations systems to be used in Kansas for will be posted to the Evaluations webpages. Student Growth Measures Online Forms are now posted and available to complete on the Kansas Evaluation website. These forms will be completed by principals. On June 30 th, a data snapshot will be taken of SGMs to be used in Kansas for This data snapshot will be used within the first evaluations annual report.

Things to Know

Student Growth Measures: Kansas school districts will include student growth as a significant factor in the evaluation of classroom teachers and building leaders. State approved student growth measures will document the specific amount of student growth attributable to the teacher or building leader between two identified points in time. Multiple measures of student growth (more than one) must be met before an educator can be rated as effective or highly effective. State assessments are one possible measure and are a required measure for all grade levels and content areas that give them. Commercially purchased assessments and locally developed performance assessments may also be used, once they are approved by the KSDE.

KSDE Guidance for school districts: LEAs should use the commercially purchased and locally developed student growth measures they currently have. State assessments are required as given. All grade levels across schools in a district should use the same measures. Local performance assessments should be collaboratively designed, reviewed and used across the district with strict adherence to an inter-rater agreement. Student Growth Objectives (SGOs) or Student Learning Objectives (SLOs) are to be developed with collaborative districtwide teams.

Next steps: All districts will identify student growth measures to be used and provide them to the KSDE (in a format to be determined) by June 30, A “default list” of student growth measures for LEA reference will be available and posted on the web by May 1, 2014.

Final Summative Rating

All Evaluations

KANSAS Final Summative Evaluation Rating Three Student Growth Measures Chosen Instructional Practice Protocol FINAL Summative Evaluation Rating IPP SUMMARY RATING SGM SUMMARY RATING

Matrix Works with or Without Percentages

Matrix Used to Determine Summative Evaluation Rating Rules: 1. Must meet all three student growth measures to be considered highly effective or its equivalent for the Student Growth Measures Summary Rating. 2. Must meet at least two student growth measures to be considered effective or its equivalent for the Student Growth Measures Summary Rating. 3. Must meet at least one student growth measure to be considered developing or its equivalent for the Student Growth Measures Summary Rating. 4. The Final Summative Rating can only be rated one performance level higher than the lowest Summary Rating. 5. When both Summary Ratings are the same, that rating becomes the Final Summative Performance Rating. NOTE: Kansas State Assessments used as a Student Growth Measure are only required for teachers of tested grades and subjects.

Criteria list for selecting or creating a LOCAL student growth measure are: A. Common assessments must be created in consultation with a school administrator with expertise in assessments, special education, ELL specialist and content expert. B. Assessments cover all key subject/grade level content standards. C. Number of test items should correlate to distribution of % of time spent teaching the content. D. Assessments should require higher order thinking as appropriate. E. Assessments should allow high and low achieving students to demonstrate their knowledge. F. Assessments should measure accurately what it is designed to measure and produce similar results for students with similar levels of ability.

SGMs Default List on the Web Student Growth Measures Webpage SGMs Default List – Elementary SGMs Default List Middle School SGMs Default List High School SGMs Trainings Webpage

SGMs Online Submissions Forms

Student Growth Measures Online Submission Form – Elementary

How the KEEP Repository Technology Works

Repository Processes A Repository is NOT the entire KEEP process. How is a Data Repository used? USES – Holds DATA Generates Reports Access for Educator Involvement Unified System Organizational Tools

Building Leader Self-Assessment Rubric

Goals – Select Goals, Write Text for Expected Outcome, Add

Goals – After Adding, then Complete and Save, can Print

Artifacts – Select Component and Source of Evidence

Artifacts – Ready to Upload

Artifact Uploaded – in table

Cycles of Conferences - Beginning, Mid, End

Summary Rating Sheet – Construct #1

Summary Rating Sheet – Construct #2

Summary Rating Sheet – Construct #3

Summary Rating Sheet – Construct #4

Summary Rating Sheet – Signatures

New Features in the KEEP Repository for Page to Document Student Growth Measures Page to Document the Final SUMMATIVE Rating Work Queue as a Dashboard District HR will have access to KEEP at their District level See KEEP 2014 Production Software Enhancements.docxKEEP 2014 Production Software Enhancements.docx

The KEEP Webpages d= News and Announcements 2. KEEP Repository Registration 3. KEEP Training Materials and Schedule 4. Assurances Information 5. Kansas Flexibility Waiver Materials 6. Archives with Materials of Previous Trainings and Meetings

Questions ?? Contacts: Bill Bagshaw, Assistant Director, TLA, KSDE Kayeri Akweks, Education Program Consultant TLA, KSDE