1. Understanding Your LI Reports October 19, 2016
Samantha Sniegowski
Researcher
AIR
October 2016
Copyright © 2016 American Institutes for Research. All rights reserved.

2. Goals for the Webinar To familiarize you with Leading Indicator report
To answer questions
To prepare you for the Advanced Planning with Data trainings
October 21 – Webinar training for Cohorts 9-12

3. Overview of LI Reports Part of overall evaluation of 21st CCLC in WA
Intended to support continuous improvement
Not intended to support compliance monitoring
Summarizes performance on best practices
Allows programs to compare performance to state
Promotes discussion

4. Where Do the Data Come From?
Information submitted by you into PPICS
Site coordinator survey
Staff survey
PQA Form A and B data
Youth survey data
Program attendance data
OSPI student data warehouse
**All data is from previous school year

5. Understanding your report
User interface
Project director and local evaluators have access
Site coordinator access
Can view summary or full report or both
5 major sections
Center Profile
Organizational Practices
Instructional Practices
Partnerships Practices
Youth Outcomes

6. User Interface

7. User interface

11. Select program year
Select grantee and center
Select report type
Select domains
Hit submit to generate report

12. Center Profile Basic characteristics Recruitment Attendance
Activity provision
Number of partners
Site Coordinator characteristics
Staff characteristics

13. Center Profile

14. Organizational Practices
1.1 – Continuous Improvement
Program Climate
Internal Communication, Staff Survey
Internal Communication, Site Coordinator Survey
1.2 – Leadership and Management
Leadership and management (Form B PQA)

15. Instructional Practices
2.1 – Instructional Quality (Content)
Intentionality in Program Design, Site Coordinator Survey
Intentionality in Program Design, Staff Survey
2.2 – Instructional Quality (Process)
Point of Service Quality (PQA Form A)
Youth Centered Policies and Practices (PQA Form B)

16. Partnership Practices
3.1 – Family Engagement
Family Communication
3.2 – School Context
Data Use, Staff Survey
Data Use, Site Coordinator Survey
Linkages to the School Day, Staff Survey
Linkages to the School Day, Site Coordinator Survey
3.3 – Community Context
Family and Community – Form B PQA

17. Sample Indicator Indicator Name Explanation of indicator
Click for more info.
No data indicates survey not completed
Scale score for state and center for all sub indicators

18. Sample Indicator Summary of all items by response category
Item by item responses

19. Sample Indicator
Celebrate Strengths
Identify areas for improvement

20. PQA Form A Data
Two types of data

21. Youth Outcomes 4.1 – Youth Program Experiences Skills and Beliefs
4.2 – Reading and Mathematics Performance (Grades 4–8)
4.3 – School Day Attendance (Grades 6–12)
4.4 – School Day Disciplinary Incidents (Grades 1–12)
4.5 – Percentage of Credits Earned (Grades 10–12)

22. Youth Outcomes
4.1 – Youth Program Experiences Skills and Beliefs

23. Youth Outcomes
4.2 – Reading and Mathematics Performance (Grades 4–8)

24. Youth Outcomes
4.3 – School Day Attendance (Grades 6–12)

25. Youth Outcomes
4.4 – School Day Disciplinary Incidents (Grades 1–12)

26. Youth Outcomes
4.5 – Percentage of Credits Earned (Grades 10–12)

27. How to Review Report
Examine graphs and tables to understand overall report and what it includes
Compare how your center is doing relative to the state average.
Celebrate your strengths!
What can you work on?
Identify two areas for improvement in preparation for Advanced Planning with Data workshop.

28. Email questions to: WA21stCCLC@air.org
Samantha Sniegowski