Menus of Best Practices and Strategies 2017-18 External Panel: Session 1 Menus of Best Practices and Strategies OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Welcome and Introductions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Zoom Meeting Norms Zoom Meeting Norms Be present Ask questions Start and end on time State your name before each comment Keep device on mute when listening Be an active participant Camera placement Have fun Image from http://ligadasaude.blogspot.com.br/2014/03/o-que-e-normal.html CCBY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Making Connections Best practices are like this image because... OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION  CC0 Public Domain via Pixabay.com

What is your WHY? What is your why? Image from http://blog.wcgworld.com/2011/08/the-golden-circle CC BY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Panel Purpose Panel Purpose To come together in collaboration to ensure alignment of messaging on best practices to strengthen student outcomes. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Focus on Students Focus on students OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Agenda Agenda Welcome Panel History History of the Menus Washington State Institute for Public Policy LAP Overview Work Plan Next steps Agenda  CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Professional Learning Adapted from Alvin Toffler, Future Shock OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Objectives for Session 1 Ground ourselves in the work Make connections Build partnerships OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Menu Panel History CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Image from http://eric01pd2012.wikispaces.com/13.+thinking+and+communicating+with+clarity+and+precision CC BY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

History of the Menus OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Menu History Timeline History 2014 2015 2016 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Strengthening Student Educational Outcomes SSEO OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Definition & Purpose What is LAP? Definition—Supplemental program that operates in addition to core instruction to serve students who are performing below standard in English language arts (ELA) and math, or both Purpose—Accelerate student growth through effective and efficient implementation practices Definition & Purpose OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

RCW 28A.165.005 (2) School districts implementing a LAP shall focus first on addressing the needs of students in grades K-4 who are deficient in reading or reading readiness skills to improve reading literacy. As provide in WAC 392.162.020 (effective 9/1/2017), approximately 50 percent of the total number of K-4 students served by LAP programs need to be enrolled in ELA LAP support. LAP First Focus OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Eligibility for LAP Services Use multiple measures of performance Eligible students score below standard in ELA or math. K–2 Readiness Skills in ELA and Math K–12 English Language Arts K–12 Mathematics Eligibility for LAP Services OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Eligibility for LAP Services Behavior Students must qualify for LAP services in ELA or math. Below standard – based on multiple performance measures in ELA or math, or both. *Students can receive LAP behavior supports without also receiving LAP services in ELA or math Eligibility for LAP Services OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Image from http://eric01pd2012.wikispaces.com/13.+thinking+and+communicating+with+clarity+and+precision CC BY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Washington State Institute for Public Policy Julia Cramer, Research Associate OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

The Learning assistance program inventory Washington State Institute for Public Policy Julia Cramer Research Associate December 12, 2017

Washington State Institute for Public Policy Non-partisan research at legislative/board direction WSIPP Board of Directors Senator Andy Billig, Co-Chair Representative Paul Graves, Co-Chair Senator Joe Fain Representative Ruth Kagi Senator Marko Liias Representative Larry Springer Senator Mark Schoesler Representative Mike Volz Susan Howson, Senate Com. Serv. Jill Reinmuth, House OPR Dir. David Schumacher, OFM Keith Phillips, Gov. Policy Dir. Sandra Archibald, UW Mary Cullinan, EWU George Bridges, TESC Robert Rosenman, WSU http://www.wsipp.wa.gov

legislative assignment “prepare an inventory of evidence-based and research-based effective practices, activities, and programs for use by school districts in the learning assistance program” (SB 5034, Sec. 610, 2013) In collaboration with the OSPI-led Expert Panels Initial inventory published July 1, 2014 (last updated July 2016) Updating now for July 1st, 2018. http://www.wsipp.wa.gov

Definitions (RCW 71.24.025) Evidence-based: Research-based: Promising: Two or more scientifically rigorous evaluations Sustained improvements in at least one outcome Cost-beneficial Tested on a diverse population   Research-based: One scientifically rigorous evaluation Promising: Has a well-established theory of change http://www.wsipp.wa.gov

Creating a WSIPP Inventory WSIPP follows a consistent process for each inventory we produce Topic identification Comprehensive literature search Screen studies for scientific rigor Systematically analyze studies Compute average “effect size” Compute benefit-cost and risk Categorize using statutory definitions http://www.wsipp.wa.gov

Literature Review Search for all studies that examine whether a program or policy causes a change in relevant outcomes. Screen for relevance and rigor: Is this study an outcome evaluation? What outcomes are measured? Is there a valid comparison group? http://www.wsipp.wa.gov

Effect size (ES) = standard metric to express magnitude of an impact Often expressed w/in “1 standard deviation” (SD = distance from the average) Summarizes direction and magnitude: Did the outcome improve or worsen? Used to combine and compare estimates from different studies The mean (average) 50th percentile More typical result from public policies 84th percentile Number of students 1 SD Low test score High test score http://www.wsipp.wa.gov

Benefit-Cost Estimates (Example: Standardized test scores) Primary source of monetary benefits: labor market earnings Economists estimate a 10% gain in average lifetime earnings per standard deviation gain in test scores. Benefits for: Participants (students) = higher earnings Taxpayer = taxes on those earnings Others in society = “spillover” effect Estimate average per-participant cost of the program. Benefits – Cost = Net benefits (in 2016 dollars) Estimate odds that B>C: 75% of the time http://www.wsipp.wa.gov

Benefit-Cost Estimates Outcomes For Which We Can Estimate Monetary Benefits Test Scores High school graduation Special education Grade retention Crime Substance use (tobacco, alcohol, drugs) Mental illness Health care usage (such as hospitalization) Child abuse and neglect Employment http://www.wsipp.wa.gov

Benefit-Cost Estimates Other Outcomes We Report But Cannot Yet “Monetize” Attendance Office Discipline Referrals Suspensions/Expulsions Grades/G.P.A Topics with studies that only report these outcomes can only be research based http://www.wsipp.wa.gov

Example: Double-dose Classes http://www.wsipp.wa.gov

Example: Double-dose classes Results Effect sizes Test scores = 0.093* HS Grad = 0.045* Benefits from: Higher labor market earnings $16,279 Lower crime and health care costs $163 Cost per student ($493) Net benefits $15,703 Odds of positive benefits 98% *p ≤ 0.20 http://www.wsipp.wa.gov

Example: Double-dose classes Classification Two or more rigorous evaluations? Yes (5) Sustained improvements in at least one outcome? (Test scores, p=0.023 HS Grad, p=0.040) Cost-beneficial? (NPV $15,703, Odds 98%) Tested on diverse population? (approx. 91% minority) Evidence-based http://www.wsipp.wa.gov

Example: Summer Book program, (Multiple years) Results Effect size 0.138 Benefits from: Higher labor market earnings $14,314 Lower crime and health care costs $26 Cost per student ($218) Net benefits $13,703 Odds of positive benefits 70% http://www.wsipp.wa.gov

Example: Summer Book program Classification Two or more rigorous evaluations? No (1) Sustained improvements in at least one outcome? (ES=0.138, p=0.346) Cost-beneficial? (NPV $13,703, Odds 70%) Tested on diverse population? Yes (approx. 78% minority) *p ≤ 0.20 Promising http://www.wsipp.wa.gov

What we need from you Well-defined topics (i.e. programs, interventions, strategies, practices) to review. Keywords Citations to studies Help classifying practices as “promising” http://www.wsipp.wa.gov

Thank You Questions? http://www.wsipp.wa.gov

LAP Funding OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

= $ Requirement Requirement OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP Base Allocation LAP Base Readiness to Learn K-2 Academic Readiness ELA ELA ELA Mathematics Mathematics Mathematics Behavior Behavior Behavior Transition Services K, 8-9 Graduation Assistance 11, 12 Transition Services K, 8-9 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

All LAP-served students K-12 K-4 Focus K-4 Focus All LAP-served students K-12 Focus on students receiving ELA interventions in grades K-4 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

All LAP-served students K-12 K-4 Focus K-4 Focus All LAP-served students K-12 50% of students receiving ELA interventions in grades K-4 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Grades 5+ Elementary School K-4 Focus K-4 Focus 50% of all K-4 students 50% of K-4 students receiving ELA interventions Middle School/Jr. High Grades 5+ Elementary School High School K-4 Elementary School OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP High Poverty Allocation LAP HP Readiness to Learn NEW 2017-18 K-2 Academic Readiness ELA ELA ELA Mathematics Mathematics Mathematics Behavior Behavior Behavior Transition Services K, 8-9 Graduation Assistance 11, 12 Transition Services K, 8-9 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

How many schools take LAP funds? 1,538 LAP Base 950 LAP HP OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

How many schools take LAP funds? 1,538 LAP Base 950 LAP HP 1716 LAP total OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Menus as guides The menus were created to guide schools and districts as they strengthen student educational outcomes.  CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

These practices are embedded. Math Menu Choices Math Menu choices State Math Menu Best Practices include: Double Dosing Summer School Programs Tutoring by an Adult Tutoring by a Peer Instructional Coaches Professional Learning Communities Targeted Professional Learning Credit Retrieval Grade 8 & Kindergarten Transitions Family Engagement Community-Based Student Mentors Math Menu Choices are not: Number Talks Math Games Academic Language Culturally Responsive Teaching Growth Mindset These practices are embedded. OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

If Tutoring by an Adult is the best practice selected:  CC0 Public Domain via Pixabay.com If Tutoring by an Adult is the best practice selected: = improvement OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Comprehensive Needs Assessment Identify the need Identify the need Comprehensive Needs Assessment Review Data  CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Implementation Fidelity Implementing with Fidelity Plan-Do-Study-Act Implementation Fidelity Image from sisep.fpg.unc.edu CC BY-NC-ND OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Looking at Systems Systems Needs Demographics Plan Best Practices  CC0 Public Domain via Pixabay.com Needs Demographics Plan Best Practices Report Results Evaluate Effectiveness OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Image from http://eric01pd2012.wikispaces.com/13.+thinking+and+communicating+with+clarity+and+precision CC BY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP Reporting OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Services Provided Services Tutoring Extended learning Readiness to learn Graduation assistance OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP Enrollment LAP Enrollment K-4 ELA 5-12 ELA Math Extended learning Readiness to learn Behavior OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP Enrollment by Grade Level OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

LAP Enrollment by Student Group Bilingual Migrant American Indian/ Alaska Native Hispanic/ Latino OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION Image from http://eric01pd2012.wikispaces.com/13.+thinking+and+communicating+with+clarity+and+precision CC BY-SA OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Work Plan OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Internal Panel Internal panel How can we improve technical assistance to serve customers with implementation best practices? How do the menus directly correspond to your role at the agency? How can we help support data-based decision-making for interventions using an MTSS and/or the ISS protocol? Do these definitions need to be updated? OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

External Panel External panel Targeted Writing Updates: Target entries for team writing and common alignment in all three menus include: High Poverty Language in LAP Professional Learning Communities Targeted Professional Learning Grade 8 Transitions School & Community Partnerships OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

First Steps: Professional Learning Communities PLCs First Steps: Professional Learning Communities  CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

PLC Practice Possibilities PLCs PLC Practice Possibilities OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

PLC School Resources PLCs Review resources OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Resources Example Identify 1-3 new resources https://ies.ed.gov/ncee/edlabs/regions/midatlantic/pdf/REL_2016144.pdf OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

PLC Research Research CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Homework Email us OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Practice Possibilities Homework Due Date?: PLC Research Practice Possibilities Resources OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Practice Possibilities Next Steps… Session 2: MTSS/ISS Practice Possibilities Resources OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Evaluation & Feedback Evaluation  CC0 Public Domain via Pixabay.com Evaluation http://www.surveygizmo.com/s3/4054738/OSPI-Menu-Panel-Evaluation-Feedback-Survey OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Making Connections CC0 Public Domain via Pixabay.com OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION