1. Menus of Best Practices and Strategies
External Panel: Session 1
Menus of Best Practices and Strategies
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

2. Welcome and Introductions
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

3. Zoom Meeting Norms Zoom Meeting Norms Be present Ask questions
Start and end on time
State your name before each comment
Keep device on mute when listening
Be an active participant
Camera placement
Have fun
Image from CCBY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

4. Making Connections Best practices are like this image because...
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
 CC0 Public Domain via Pixabay.com

5. What is your WHY? What is your why?
Image from CC BY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

6. Panel Purpose
Panel Purpose
To come together in collaboration to ensure alignment of messaging on best practices to strengthen student outcomes.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

7. Focus on Students Focus on students
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

8. Agenda Agenda Welcome Panel History History of the Menus
Washington State Institute for Public Policy
LAP Overview
Work Plan
Next steps
Agenda
 CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

9. Professional Learning
Adapted from Alvin Toffler, Future Shock
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

10. Objectives for Session 1
Ground ourselves in the work
Make connections
Build partnerships
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

11. Menu Panel History CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

12. Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Image from CC BY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

13. History of the Menus
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

14. Menu History Timeline History 2014 2015 2016
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

15. Strengthening Student Educational Outcomes
SSEO
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

16. Definition & Purpose What is LAP?
Definition—Supplemental program that operates in addition to core instruction to serve students who are performing below standard in English language arts (ELA) and math, or both
Purpose—Accelerate student growth through effective and efficient implementation practices
Definition & Purpose
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

17. RCW 28A (2)
School districts implementing a LAP shall focus first on addressing the needs of students in grades K-4 who are deficient in reading or reading readiness skills to improve reading literacy.
As provide in WAC (effective 9/1/2017), approximately 50 percent of the total number of K-4 students served by LAP programs need to be enrolled in ELA LAP support.
LAP First Focus
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

18. Eligibility for LAP Services
Use multiple measures of performance
Eligible students score below standard in ELA or math.
K–2 Readiness Skills in ELA and Math
K–12 English Language Arts
K–12 Mathematics
Eligibility for LAP Services
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

19. Eligibility for LAP Services
Behavior
Students must qualify for LAP services in ELA or math. Below standard – based on multiple performance measures in ELA or math, or both.
*Students can receive LAP behavior supports without also receiving LAP services in ELA or math
Eligibility for LAP Services
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

20. Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Image from CC BY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

21. Washington State Institute for Public Policy
Julia Cramer, Research Associate
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

22. The Learning assistance program inventory Washington State Institute for Public Policy Julia Cramer Research Associate
December 12, 2017

23. Washington State Institute for Public Policy
Non-partisan research at legislative/board direction
WSIPP Board of Directors
Senator Andy Billig, Co-Chair
Representative Paul Graves, Co-Chair
Senator Joe Fain
Representative Ruth Kagi
Senator Marko Liias
Representative Larry Springer
Senator Mark Schoesler
Representative Mike Volz
Susan Howson, Senate Com. Serv.
Jill Reinmuth, House OPR Dir.
David Schumacher, OFM
Keith Phillips, Gov. Policy Dir.
Sandra Archibald, UW
Mary Cullinan, EWU
George Bridges, TESC
Robert Rosenman, WSU

24. legislative assignment
“prepare an inventory of evidence-based and research-based effective practices, activities, and programs for use by school districts in the learning assistance program” (SB 5034, Sec. 610, 2013)
In collaboration with the OSPI-led Expert Panels
Initial inventory published July 1, (last updated July 2016)
Updating now for July 1st, 2018.

25. Definitions (RCW 71.24.025) Evidence-based: Research-based: Promising:
Two or more scientifically rigorous evaluations
Sustained improvements in at least one outcome
Cost-beneficial
Tested on a diverse population
Research-based:
One scientifically rigorous evaluation
Promising:
Has a well-established theory of change

26. Creating a WSIPP Inventory
WSIPP follows a consistent process for each inventory we produce
Topic identification
Comprehensive literature search
Screen studies for scientific rigor
Systematically analyze studies
Compute average
“effect size”
Compute benefit-cost and risk
Categorize using statutory definitions

27. Literature Review
Search for all studies that examine whether a program or policy causes a change in relevant outcomes.
Screen for relevance and rigor:
Is this study an outcome evaluation?
What outcomes are measured?
Is there a valid comparison group?

28. Effect size (ES) = standard metric to express magnitude of an impact
Often expressed w/in “1 standard deviation” (SD = distance from the average)
Summarizes direction and magnitude: Did the outcome improve or worsen?
Used to combine and compare estimates from different studies
The mean (average) 50th percentile
More typical result from public policies
84th percentile
Number of students
1 SD
Low test score
High test score

29. Benefit-Cost Estimates (Example: Standardized test scores)
Primary source of monetary benefits: labor market earnings
Economists estimate a 10% gain in average lifetime earnings per standard deviation gain in test scores.
Benefits for:
Participants (students) = higher earnings
Taxpayer = taxes on those earnings
Others in society = “spillover” effect
Estimate average per-participant cost of the program.
Benefits – Cost = Net benefits (in 2016 dollars)
Estimate odds that B>C: 75% of the time

30. Benefit-Cost Estimates
Outcomes For Which We Can Estimate Monetary Benefits
Test Scores
High school graduation
Special education
Grade retention
Crime
Substance use (tobacco, alcohol, drugs)
Mental illness
Health care usage (such as hospitalization)
Child abuse and neglect
Employment

31. Benefit-Cost Estimates
Other Outcomes We Report But Cannot Yet “Monetize”
Attendance
Office Discipline Referrals
Suspensions/Expulsions
Grades/G.P.A
Topics with studies that only report these outcomes can only be research based

32. Example: Double-dose Classes

33. Example: Double-dose classes
Results
Effect sizes
Test scores = 0.093*
HS Grad = 0.045*
Benefits from:
Higher labor market earnings
$16,279
Lower crime and health care costs
$163
Cost per student
($493)
Net benefits
$15,703
Odds of positive benefits
98%
*p ≤ 0.20

34. Example: Double-dose classes
Classification
Two or more rigorous evaluations?
Yes
(5)
Sustained improvements in at least one outcome?
(Test scores, p=0.023
HS Grad, p=0.040)
Cost-beneficial?
(NPV $15,703, Odds 98%)
Tested on diverse population?
(approx. 91% minority)
Evidence-based

35. Example: Summer Book program, (Multiple years)
Results
Effect size
0.138
Benefits from:
Higher labor market earnings
$14,314
Lower crime and health care costs
$26
Cost per student
($218)
Net benefits
$13,703
Odds of positive benefits
70%

36. Example: Summer Book program
Classification
Two or more rigorous evaluations? No
(1)
Sustained improvements in at least one outcome?
(ES=0.138, p=0.346)
Cost-beneficial?
(NPV $13,703, Odds 70%)
Tested on diverse population?
Yes
(approx. 78% minority)
*p ≤ 0.20
Promising

37. What we need from you
Well-defined topics (i.e. programs, interventions, strategies, practices) to review.
Keywords
Citations to studies
Help classifying practices as “promising”

38. Thank You
Questions?

39. LAP Funding
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

40. = $ Requirement Requirement
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

41. LAP Base Allocation LAP Base Readiness to Learn K-2 Academic Readiness
ELA
ELA
ELA
Mathematics
Mathematics
Mathematics
Behavior
Behavior
Behavior
Transition Services K, 8-9
Graduation Assistance 11, 12
Transition Services K, 8-9
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

42. All LAP-served students K-12
K-4 Focus
K-4 Focus
All LAP-served students K-12
Focus on students receiving ELA interventions in grades K-4
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

43. All LAP-served students K-12
K-4 Focus
K-4 Focus
All LAP-served students K-12
50% of students receiving ELA interventions in grades K-4
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

44. Grades 5+ Elementary School
K-4 Focus
K-4 Focus
50% of all K-4 students
50% of
K-4 students
receiving ELA
interventions
Middle School/Jr. High
Grades 5+ Elementary School
High School
K-4 Elementary School
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

45. LAP High Poverty Allocation
LAP HP
Readiness to Learn
NEW
K-2 Academic Readiness
ELA
ELA
ELA
Mathematics
Mathematics
Mathematics
Behavior
Behavior
Behavior
Transition Services K, 8-9
Graduation Assistance 11, 12
Transition Services K, 8-9
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

46. How many schools take LAP funds?
1,538 LAP Base
950 LAP HP
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

47. How many schools take LAP funds?
1,538 LAP Base
950 LAP HP
1716 LAP total
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

48. Menus as guides
The menus were created to guide schools and districts as they strengthen student educational outcomes.
 CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

49. These practices are embedded.
Math Menu Choices
Math Menu choices
State Math Menu Best Practices include:
Double Dosing
Summer School Programs
Tutoring by an Adult
Tutoring by a Peer
Instructional Coaches
Professional Learning Communities
Targeted Professional Learning
Credit Retrieval
Grade 8 & Kindergarten Transitions
Family Engagement
Community-Based Student Mentors
Math Menu Choices are not:
Number Talks
Math Games
Academic Language
Culturally Responsive Teaching
Growth Mindset
These practices are embedded.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

50. If Tutoring by an Adult is the best practice selected:
 CC0 Public Domain via Pixabay.com
If Tutoring by an Adult is the best practice selected:
= improvement
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

51. Comprehensive Needs Assessment
Identify the need
Identify the need
Comprehensive Needs Assessment
Review
Data
 CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

52. Implementation Fidelity
Implementing with Fidelity
Plan-Do-Study-Act
Implementation Fidelity
Image from sisep.fpg.unc.edu CC BY-NC-ND
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

53. Looking at Systems Systems Needs Demographics Plan Best Practices
 CC0 Public Domain via Pixabay.com
Needs
Demographics
Plan
Best Practices
Report Results
Evaluate Effectiveness
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

54. Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Image from CC BY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

55. LAP Reporting
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

56. Services Provided Services Tutoring Extended learning
Readiness to learn
Graduation assistance
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

57. LAP Enrollment LAP Enrollment K-4 ELA 5-12 ELA Math Extended learning
Readiness to learn
Behavior
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

58. LAP Enrollment by Grade Level
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

59. LAP Enrollment by Student Group
Bilingual
Migrant
American Indian/
Alaska Native
Hispanic/
Latino
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

60. Discussion Questions OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Image from CC BY-SA
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

61. Work Plan
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

62. Internal Panel Internal panel
How can we improve technical assistance to serve customers with implementation best practices?
How do the menus directly correspond to your role at the agency?
How can we help support data-based decision-making for interventions using an MTSS and/or the ISS protocol?
Do these definitions need to be updated?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

63. External Panel External panel Targeted Writing Updates:
Target entries for team writing and common alignment in all three menus include:
High Poverty Language in LAP
Professional Learning Communities
Targeted Professional Learning
Grade 8 Transitions
School & Community Partnerships
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

64. First Steps: Professional Learning Communities
PLCs
First Steps: Professional Learning Communities
 CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

65. PLC Practice Possibilities
PLCs
PLC Practice Possibilities
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

66. PLC School Resources PLCs Review resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

67. Resources Example Identify 1-3 new resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

68. PLC Research Research CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

69. Homework us
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

70. Practice Possibilities
Homework
Due Date?:
PLC Research
Practice Possibilities
Resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

71. Practice Possibilities
Next Steps…
Session 2:
MTSS/ISS
Practice Possibilities
Resources
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

72. Evaluation & Feedback Evaluation
 CC0 Public Domain via Pixabay.com
Evaluation
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

73. Making Connections CC0 Public Domain via Pixabay.com
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION