Washington PBIS Conference Northwest PBIS Network Spokane, WA November 2013 Nadia K. Sampson & Dr. Kelsey R. Morris University of Oregon

Introductions & Presentation Goals Collecting Data for Decision Making PBIS Applications Overview Analyzing Data to Enhance Decision Making Essential Questions Are we doing what we said we would do? Is it making a positive difference in student outcomes? Questions & Answers

School/Facility SWIS User CICO-SWIS User ISIS-SWIS Coordinator or User PBIS Assessment User District, Regional, Program, or State Implementer or Coach Manager or Evaluator PBIS Assessment Coordinator PBIS Evaluation User SWIS Suite Facilitator Other

Intended Audience: Individuals wanting to monitor progress and implementation fidelity at the student, school/facility, or multi- site level (e.g., district, region, state). What you should leave with: An overview of the PBIS Applications available Examples of how to use PBISApps data for progress monitoring and implementation fidelity Examples of how the applications function and can be incorporated into decision systems

PBISApps is was developed and is operated by Educational and Community Supports (ECS), a research unit at the University of Oregon. The PBISApps team manages a series of educational tools related to the implementation of multi-tiered support systems (MTSS): School-Wide Information System (SWIS) Suite including SWIS, CICO-SWIS, ISIS-SWIS PBIS Assessment PBIS Evaluation PBIS Applications have been implemented in more than 25,000 schools in the U.S. and abroad.

ISIS-SWIS is a decision system for students requiring more intensive and individualized supports for academic, social, or mental health services. CICO-SWIS is a decision system for targeted or group- based interventions for students needing additional support beyond the Universal or Tier I system. The School-Wide Information System (SWIS) is a web- based decision system designed to help school/facility personnel use office referral data to monitor progress of school-wide and individual student interventions.

The SWIS Suite is a set of four applications (SWIS, CICO-SWIS, ISIS-SWIS, SAMI) designed to assist schools in using information for decision making which makes a team more effective and efficient. The right information given in the right format, at the right time, to the right people enhances the quality of decision making. Teams will ask questions of their data such as… Do we have a problem? What is the problem? Where, when, why, and how are problems occurring?

PBIS Assessment is a web-based application designed to offer a variety of tools for measuring and monitoring high-fidelity, sustained implementation of school-wide positive behavioral interventions and supports (SWPBIS). Are we doing what we said we would do?

Using PBIS Assessment data improves the efficiency and accuracy of: Initial assessment of discipline practices. Implementation assessment of the fidelity with which schools use SWPBIS procedures. Sustained assessment of SWPBIS implementation at all three tiers to promote ongoing use of core SWPBIS features. PBIS Assessment assists in designing action plans to improve SWPBIS implementation fidelity.

Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Individual Student School- wide Evaluation Tool (ISSET) Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

To get a PBIS Assessment account: Identify a local (district/regional) PBIS Assessment Coordinator PBIS Assessment Coordinator will provide your school with an account code to login

The PBIS Evaluation website allows state, regional, and district leadership teams to use implementation fidelity and student outcome data to evaluate the impact of their PBIS implementation. PBISEval is a reporting tool that aggregates SWIS Suite and PBIS Assessment data across multiple schools in an identified state, region, or district.

A PBIS Evaluation account allows teams to: View state, district, or regional data. View multiple schools at the same time. Create customized cohorts of schools. Compare SWPBIS implementation to student outcomes.

A PBIS Evaluation account is available to any state, region, or district with a SWPBIS leadership team actively engaged in SWPBIS implementation. 1.Review Introduction to PBIS Evaluation available at pbisapps.org 2.Contact 3.Determine data-sharing agreements 4.Schedule demonstration/training

Your annual subscription starts the day your team’s account is activated. Your account will be renewed automatically each year. Region SizePrice District license$500 Regional license$750 State license$1000

Are we doing what we said we would do? Is it making a positive difference in student outcomes?

What information do we already collect? How will we use the information we have? What do we need to make good decisions on a daily, weekly, and monthly schedule? What do we need to make good decisions on a quarterly or annual schedule? What is possible? What is doable?

What are our systems and procedures for collecting data? What are our systems and procedures for analyzing and sharing data? How are teams organized to use data for decision making?

Are we doing what we said we would do?

PBIS Assessment Teams can review current implementation data for the school year across tiers of implementation. Discuss implications and action planning. Research Tool Annual Assessment Tool Progress Monitoring Tool Universal System School-wide Evaluation Tool (SET) Benchmarks of Quality (BoQ) Early Childhood BoQ (EC BoQ) PBIS Self-Assessment Survey (SAS) Team Implementation Checklist (TIC) Secondary & Tertiary Systems Individual Student School-wide Evaluation Tool (ISSET) Benchmarks of Advanced Tiers (BAT) PBIS Self-Assessment Survey (SAS) Monitoring Advanced Tiers Tool (MATT) Outcome Measures: School Safety Survey

Is it making a positive difference in student outcomes?

SWIS Suite SWIS School-wide data CICO-SWIS Targeted, small group data ISIS-SWIS Individualized intervention data

SWIS assists in identifying school-wide patterns and problems The SWIS Dashboard serves as an indicator of current levels of activity within the school/facility

The SWIS Drill Down feature allows for a deeper level of analysis formatted by selected filters

CICO-SWIS assists in progress monitoring students participating in the Check- In Check-Out intervention.

The Average Daily Points report within CICO helps answer depicts how is each student doing in relation to the school- wide goal.

ISIS-SWIS assists in progress monitoring individual students with specific behavior support plans.

Brian Bender Brian is a creative and thoughtful eighth grader with a history of academic and behavioral problems in the classroom. Brian is a student who receives academic and behavioral Tier III supports.

The Individual Student Dashboard within SWIS provides a summary report of a student’s office discipline referral patterns.

Question for Analysis: What is the student’s pattern over time?

Question for Analysis: What does the student’s average day look like?

Question for Analysis: What is the student’s pattern over time in a single period?

State Region District School

PBIS Evaluation collects data from the SWIS Suite as well as PBIS Assessment to help districts, regions, and states analyze: Which schools are actively engaged in SWPBIS implementation? Are schools implementing SWPBIS with fidelity? Is the implementation having an effect on student behavior?

Summary of Schools Adopting SWPBIS

Summary of SWPBIS Schools by Grade Level

Are schools implementing SWPBIS to criterion? SET Subscale Report

Are schools implementing SWPBIS to criterion? BoQ Subscale Report

Is SWPBIS implementation affecting student outcomes? ODR/100/Day

Is SWPBIS implementation affecting student outcomes? ODR’s by Problem Behavior

Is SWPBIS implementation affecting student outcomes? ODR’s by Ethnicity

Is SWPBIS implementation affecting student outcomes? Suspension Report

Is SWPBIS implementation affecting student outcomes? Triangle Report

Is SWPBIS implementation affecting student outcomes? CICO-SWIS: Students Succeeding