1. Data-based Decision Making and Problem Solving in PBIS Schools VTPBiS Leadership Forum October 9, 2015

2. Agenda Data Team Meeting – TIPS Meeting Process – Data Analyst – SWIS Updates – Solution Development Now what? – Sharing Data with Staff Q & A – Networking Resources – VTPBiS Assessment Schedule – BAT

4. Activity! With your neighbor, discuss the following: What were your successes and challenges in using PBIS data so far this year? (fidelity and/or student outcome measures) In a moment, we will ask for a sampling of responses.

5. Welcome Data Team! Team Initiated Problem Solving (TIPS) 1.A structured meeting process – Formal roles (facilitator, recorder, data analyst) – Access and use of data – Use of electronic and projected meeting minutes 2. A process for using data to make decisions – Formal problem solving steps that a group can use to build and implement solutions. – Access to the right information at the right time in the right format

6. Effective meetings extend before and after the actual meeting time. Other key roles are necessary! BEFORE: Set agenda and send to team Collect data, review, and prepare summary statements DURING: Follow agenda & time frames Review data Make precision problem statements Develop solutions Take notes and set action items AFTER: Complete action items Follow-up on action item status

7. Skills for Meeting Roles Facilitator Asks questions Implements group norms Keeps people on track (back on track) Note Taker Uses computer Word processer Save files Edit files Listens to a discussion and paraphrase critical information Is fluent with meeting minute form Data Analyst Likes data Navigates through application Discriminates what to ask when creating custom reports Creates a story from data summary For new problems Status on old problems Newton, J. S., Todd, A. W., Algozzine, K., Horner, R. H., & Algozzine, B. (2009). The Team Initiated Problem Solving (TIPS) Training Manual. Educational and Community Supports, University of Oregon, unpublished training manual.

8. Identify a Data Analyst Role & Responsibilities Create relevant data summaries for team to review Facilitate a problem solving discussion, Evaluate the impact of solutions and fidelity of implementation Prepare a brief written summary for distribution at meetings Help to generate reports during the meeting as questions of the data arise

9. POLL: To what extent does someone function as data analyst in your PBIS planning meetings? 1.Data is not used in our meetings so there is no need for a data analyst 2.There is no one in particular serving in this role. The Team reviews and analyzes the data together at the meetings. 3.One person on the team brings data to the meeting for the team to review. 4.There is a person identified in this role who prepares data for review and points out trends in advance for discussion and problem solving at meetings.

10. TIPS Problem-Solving “Mantra” 1.Do we have a problem? (identify) 2.What is the precise nature of our problem? (define, clarify, confirm/disconfirm inferences) 3.Why does the problem exist, & what can we do about it? (hypothesis & solution) 4.What are the actual elements of our plan? (Action Plan) 5.Is our plan being implemented, & is it working? (evaluate & revise plan) Innovation neutral: Use for Reading, Behavior, Math, School Improvement REMEMBER to use…..

11. Look for gaps and trends in your data How do our data compare with last year? How do our data compare with national/regional norms? How do our data compare with our preferred/expected status? 1. Do we have a problem (identify)?

12. Types of data to consider

13. Data Analyst found the following trends…… Disruption in the cafeteria Middle of the day

14. 2. What is the precise nature of our problem (define, clarify, confirm/disconfirm inferences)? QuestionSWIS Table/Graph What problem behaviors are occurring? Referrals by problem behavior When are problem behaviors occurring? Referrals by time Where are problem behaviors occurring? Referrals by location Who is engaging in problem behaviors? Referrals by student Why do problem behaviors keep happening? Referrals by motivation

15. Go to Your Data!

16. What?

17. When?

18. Where?

19. Who?

20. Our Precise Problem Statement…. Students in ______ grade are _______________ (Grade/s) (Problem Behavior/s) in the ________________between (Location/s) ________and _________. (Start Time) (End Time) We need to take it one step further……Why is this happening?

21. 3. Why does the problem exist, & what can we do about it? (hypothesis & solution) Problem Statement: The sixth graders are disruptive & use inappropriate language in the cafeteria between 11:30 AM and 12:00 PM Hypothesis: ??????

22. Why?

23. 4. What are the actual elements of our plan? Prevention Teaching Reward Extinction Corrective Consequence Data Collection Problem: The sixth graders are disruptive & use inappropriate language in the cafeteria between 11:30 AM and 12:00 PM to get peer attention.

24. Solution development for disruption in cafeteria Prevention: Remove/alter “trigger” for problem behavior Maintain current lunch schedule, but shift classes to balance numbers. Teaching: Define, instruct & model expected behavior Teach behavioral expectations in cafeteria Reward: Expected/alternative behavior when it occurs; prompt as necessary Establish “Friday Five”: Extra 5 min of lunch on Friday for five good days. Extinction: Increase acknowledgement of presence of desired behavior Encourage all students to work for “Friday Five”… make problem behavior less rewarding than desired behavior Corrective Consequence: Use non- rewarding/non-reinforcing responses when problem behavior occurs Active supervision and continued early consequence (ODR) Data Collection: Indicate how you know when you have a solution Maintain ODR record and supervisor weekly report

25. ….including logistics:

26. 5. Is our plan being implemented & is it working? (evaluate & revise plan) Ask the following: What will ‘it’ look like when you say it is not a problem? How often will you conduct a status review? How you will know that the solutions had a positive effect on student achievement, social competence, and/or safety? How often will you monitor student progress? What will the data tell you when the problem is solved?

27. Next Steps…. At the end of the meeting….. Finalize next meeting date and agenda items Evaluate how the meet went today After the meeting…… Distribute Meeting Minutes and Problem- Solving Form to team members within 24 hours

28. Now what? Share data and plan with your staff!

29. Killington Grand Middle School – Aug. 1 through Oct. 6, 2015 Problem: The sixth graders are disruptive & use inappropriate language in the cafeteria between 11:30 AM and 12:00 PM to get peer attention.

30. Our Plan…….. Prevention: Maintain current lunch schedule, but shift classes to balance numbers. – 6 th graders will now eat with the 7 th graders, not 8 th graders Teaching: All students should be reminded of the cafeteria expectations before leaving the classroom. Please use the Teaching Matrix 6 th Grade Teachers and Para Educators - – Set aside time at the beginning of lunch to role model one of the expectations until all have been covered this week.

31. Acknowledge students for following the expectations: We’d like to establish “Friday Five” – an Extra 5 min of lunch on Friday for five good days. Extinction: Be diligent about acknowledging positive behaviors in the cafeteria by handing out our BEST Bucks. Our goal is to make appropriate behaviors much more desirable

32. Corrective Consequence: We plan to increase and have more active supervision (e.g. Walking around during lunch, talking with students, etc….). Continued early consequence, if necessary (Minor - ODRs) Data Collection: We will continue to record ODRs and will follow-up in a week to see if problem behaviors decreased.

33. Fast Forward 6 weeks…..

34. Killington Grand Middle School – November 23, 2015 BEFORE AFTER

35. Example Data Team Meeting https://youtu.be/ZCr4MyTCAxw

36. Guiding Questions Think about this question again….. What were your successes and challenges in using PBIS data this year? What is one strategy you plan to implement back at your school?

37. Resources and Next Steps! Review VTPBiS Assessment Schedule – – Complete the BoQ, SAS & BAT (January – March, 2016) Check out the VTPBiS Professional Learning Calendar for training opportunities Contact your State TA for support Use each other as resources!!!

38. Additional Questions? Contact your State Technical Assistance Providers www.pbisvermont.org

39. Thank you!