Monica Ballay Data Triangulation: Measuring Implementation of SPDG Focus Areas

Considerations This webinar is being recorded and will be available for viewing at If you need to ask a question, please use the Chat Pod on bottom right of your screen To download the materials for today, you can click on the files in the file share pod on your screen and save them to your computer 2

Roll Call At this time, EVERYONE please use your chat pod and type your first and last name as well as your district/LEA that you are representing 3

People First Language Kathie Snow. (n.d.) A few words about People First Language. Disability is Natural. Retrieved August 1, 2012 from “People First Language puts the person before the disability and describes what a person has, not who a person is.”

Goal: Use several data points to measure the implementation and outcomes of Family Engagement, Inclusive Practices, and Cultural Responsive Practices Objectives: Utilize data to make data-based decisions Gain knowledge of Identifiers of Practice (IoP) Gain skills on how to triangulate multiple data points to assess focus area outcomes

What is Professional Development? Webinar Seminar Training Workshop All of the above Answer the Poll Question:

How do you know if a process or program is Effective? (Teacher, Administrator, district staff, parent, etc.) Co-Teaching ??? Million Dollar Question

Before the effectiveness of a process/program can be measured accurately, the following must have been established: What is the expectation for all? Why are we doing this? Has it been defined to all? Has the appropriate Professional Development (PD) been provided to all involved? Is on-going support and follow-up PD in place? Does the Infrastructure support it? Have appropriate resources been provided? *If not the data results & outcomes will be inconclusive. Prerequisite Elements:

Effectiveness Varying Levels of Effective!

Data Triangulations A type of data analysis A method to determine the effectiveness Single data source may lead to errors in your decision making Definition: Validation of data through cross verification from two or more sources. ◦ Sources could be…  Qualitative – Survey, feedback, interview, etc.  Quantitative – Standardized test scores, interventions data, graduation rate, attendance, discipline data, etc.  Combination of Qualitative & Quantitative

Data Triangulations: New Year’s Resolution “Increase Healthy Living”

Measure SPDG Outcomes Focus Areas: Family Engagement, Cultural Responsive Practices, Inclusive Practices Data Points: ◦ Quality Indicator (QI) - LEA & School ◦ Identifiers of Practice (IoP) – on-site process ◦ SPP Indicators (1,3c, 4a & 4b, 8, 9, 10) ◦ PD training events & number of participates ◦ Survey & event feedback results

Quality Indicators (QI) Quality Indicator (QI) is a self-assessment tool completed by LEA & School Leadership Team. QI data helps a leadership team assess where they are in implementing indicators by focus area.

Indicators of Practice (IoP) Identifiers of Practice (IoP) is a tool to help each LEA Leadership Teams assess the implementation progress and future needs based on the focus areas. Process is completed by a group of people not the LEA Leadership Team.

SPP Data ◦ SPP Indicators (1,3c, 4a & 4b, 8, 9, 10)

PD training events & number of participates

Survey & event feedback results

Recap SPDG outcomes Assess Multiple Data Points: ◦ Quality Indicator (QI) - LEA & School ◦ Identifiers of Practice (IoP) – on-site process ◦ SPP Indicators (1,3c, 4a & 4b, 8, 9, 10) ◦ PD training events & number of participates ◦ Survey & event feedback results

Have you ever heard... Co-Teaching does not work? Yes or No Answer the Poll Question:

What is a reason “Co- Teaching” may not work? Use the Chat Pod to answer:

Best question to ask…. Key: Get to Root Cause!

Focus Area: Inclusive Practices Example: Co-Teaching How do you know if Co-Teaching is working/effective?

Million Dollar Question: Is Co-Teaching Effective? Assess if the the following been established: Expectations for All: ◦ All students can learn Definition to All: ◦ Co-Teaching is a service delivery option. It is a learning environment where 2 or more educators share the responsibility of lesson planning, delivery of instruction, and progress monitoring for all students in the class.

Appropriate Professional Development: ◦ Models of Co-Teaching:  One Teaching, One Observing  Station Teaching  Parallel Teaching  Alternative Teaching  Teaming  One Teaching, One Assisting ◦ FBA/BIP ◦ Accommodations & Modifications Infrastructure in place: ◦ School schedule ◦ Pairing of educators Resources: ◦ Common planning time ◦ Needs forms ◦ Books, DVD, etc.

Evaluation of Co-Teaching Program Identify Population & Processes: Students ◦ Formative & Summative assessments of achievement ◦ Behavior & Attendance ◦ Perceptions (survey, feedback, interview, etc.) Professionals ◦ Classroom observations (walk-throughs, formal) ◦ Perceptions (survey, feedback, interview, etc.) Family & Community Members ◦ Perceptions (survey, feedback, interview, etc.)

Formative & Summative Student Data: Attendance, Behavior, Academics, Standardized Testing Who? When? How? Process to share data results?

Formative Assessment: Walk Through for Co-Teaching Classroom Who? When? How? Process to share data results?

10 Steps to Implementing Effective Inclusive Practices A Guide for School Site Leaders

10 Steps to Implementing Effective Inclusive Practices A Guide for School Site Leaders

Inventory Survey for Professionals:

Qualitative Feedback: Perceptions Surveys, Feedback Forms, Interview, Focus Groups, etc. Who? Students, Family, Staff When? Once year, 2x year… How? Electronic, face-to-face Process to share data results?

Focus Area: Inclusive Practices Example: Co-Teaching How do you know if Co-Teaching is working/effective?

Recap: Data Triangulation Validation of data through cross verification from two or more sources. ◦ Sources could be…  Qualitative – Survey, feedback, interview, etc.  Quantitative – Standardized test scores, interventions data, graduation rate, attendance, discipline data, etc.

If you ever hear again…. PBIS does not work… Inclusive practices does not work… Family engagement does not work… RTI does not work…

Building Capacity When you leave today, what will you do with this information? How will you share it with others in your district? When will you share it? (Timeline)

The contents of this PowerPoint presentation were developed under a grant from the US Department of Education, #H323A However those contents do not necessarily represent the policy of the US Department of Education, and you should not assume endorsement by the Federal Government. Monica Ballay

We want your feedback! We are about to launch a quick survey If you have pop up blockers enabled, you can go directly to the survey at After completion of the survey, you are finished; we will be closing the webinar shortly Thank you for your time!