1. Using Data To Build, Grow, And Sustain Your Afterschool System In Partnership with May 13, 2015 @aypf_tweets @afterschool4all

2. Webinar Technical Support GoToWebinar Technical Assistance: 1-800-263-6317 To submit live questions, please use the “Questions” box on the control panel A recording of the webinar and other resources will be available at www.aypf.org @afterschool4all

3.  Role of Data in Building Afterschool Systems: Needs Assessment  Mila Yochum, Director, Allegheny Partners for Out-of-School Time (APOST)  Audience Q&A  Role of Data in Scaling Afterschool System: Use of Quality Improvement Tools for Accountability  Charles Smith, Executive Director, David P. Weikart Center for Youth Program Quality  Audience Q&A  Role of Data in Sustaining Afterschool System: Communicating Outcomes  Lisa Caruthers, Director, Center for Afterschool, Summer and Expanded Learning (CASE) for Kids  Audience Q&A  Closing Remarks: Using Data in Afterschool Systems-Building  Jen Rinehart, Vice President, Research & Policy, Afterschool Alliance Agenda @afterschool4all

4. Mila Yochum, Director, Allegheny Partners for Out-of-School Time (APOST)

5.  Youth in Allegheny County will realize their fullest potential by participating in high quality out-of- school time opportunities.  APOST focuses on improving quality of and access to out-of- school time opportunities through committed collaborative and innovative efforts of community organizations, government, foundations, schools and other partners.

6. About Allegheny Partners for Out-of-School Time (APOST)  Strategies  Quality Campaign  Professional Development of Youth Practitioner  Marketing, Communication and Outreach  Policy for Funding Sustainability  Partnerships, Convening and community based system-building

7. The Need for Data http://www.afterschoolpgh.org/state-of-afterschool-reports/

9. The Funding Inventory

10. The State of OST Programs

11. For every 1000 school-age children in a given zip code, there are 3 OST programs

12. The Funding Inventory For every 1000 school-age children in poverty a given zip code, there are 19 OST programs

13.  Marketing, Communication and Outreach  Policy for Funding Sustainability  Partnerships, Convening and community based system-building Using Information and Data

14. Mila Yochum Director APOST (Allegheny Partners for Out-of-School Time) Mila.yochum@uwac.org Questions & Contact Information

15. Questions?  To submit live questions, please use the “Questions” box on the control panel

16. Charles Smith, Executive Director, David P. Weikart Center for Youth Program Quality

17. QIS for Afterschool Services | May 13, 2015 Quality Improvement Systems (QIS) that Build & Grow Afterschool Services: Exemplary QIS in 21 st CCLC

18. QIS for Afterschool Services | May 13, 2015 Necessaries for a QIS QIS elements Lower stakes approach Effective Performance Data

19. QIS for Afterschool Services | May 13, 2015 Service Production Map Transfer Outcome Staff Engagement Quality Management Practices Quality Instructional Practices Skill-building Youth Engagement Network Leader Engagement Quality System Building

20. QIS for Afterschool Services | May 13, 2015 Staff Engagement Quality Management Practices Quality Instructional Practices Skill-Building Youth Engagement Network Leader Engagement Quality System Building Vertical Communication Horizontal Communication Job Satisfaction Staff Capacity Continuous Quality Improvement Youth Role in Governance Communication Student Data Community Engagement Youth Engagement and Belonging Academic Planning Homework Completion Instructional Quality School-Day Content Growth and Mastery Focus California Outcomes Toolbox (Vandell et al) DESSA Mini (Devereaux/Apperson) Access Targeting Academic Risk Accountability Collaboration Job satisfaction

21. QIS for Afterschool Services | May 13, 2015 Item Level Description Targeting Academic Risk Proportion of students statement is true for: “1” = Almost none, “3” = About half, “5” = Almost all Targeted because scored below “proficient" on local or state assessments Targeted because did not receive a passing grade in preceding period Referred by a teacher for assistance in reading, mathematics or science Targeted because of status as an English Language Learner (ELL)

22. QIS for Afterschool Services | May 13, 2015 Telling Stories with Data Growth & ContributionProfiles

23. QIS for Afterschool Services | May 13, 2015 In closing… Scale of the Leading Indicators systems Early findings Continuous improvement culture AND systems

24. QIS for Afterschool Services | May 13, 2015 Contact:For More Information: Charles Smith charles@cypq.org www.cypq.org Arkansas 21 st CCLC 2012-13 Statewide Evaluation ReportArkansas 21 st CCLC 2012-13 Statewide Evaluation Report Oklahoma 21 st CCLC Statewide Evaluation ReportOklahoma 21 st CCLC Statewide Evaluation Report Leading Indicators Performance Measurement SystemLeading Indicators Performance Measurement System

25. Questions?  To submit live questions, please use the “Questions” box on the control panel

26. Lisa Caruthers, Director, Center for Afterschool, Summer and Expanded Learning (CASE) for Kids Harris County Department of Education

27. Webinar 5.13.2015 ENRICH Afterschool: A Collaborative Research Initiative Lisa Thompson Caruthers, MSW, Ph.D., Harris County Department of Education Director, Center for Afterschool, Summer and Expanded Learning (CASE) for Kids E valuating Out-of-School Time N eeds, R esources and I nitiatives in the C ommunities of H ouston

28. Primary Goal: – Use research to drive change: Phase I: Funding Map Logic Model Stakeholder Perception Study Historical Trend Analysis Phase II: Return on Investment Study Best Practice Study Impact Study

29. Funds/Resources Used for Houston/Harris County After-School and Out-of-School Time Programming

30. 1.4 M 837,714 US Census/TEA 830,776 Estimated Harris County Youth Participating in Out-of-School Time Programming *,** 214,118 30,000 44,461 *Public funding streams have different attendance requirements which determine how youth are counted as served. This final estimate is based on publically available or self-report average daily attendance from participating ERNICH After-School organizations. ** US Census, 2011, American Community Survey 25% est. served 5% est. served 3% est. served daily

31. Return on Investment Framework Cost Analysis (Survey) Identify the current financial investment in after-school programs and the outputs it supports Collect program and cost data at an organizational level Cost-Benefit Analysis (Literature Review) Examine the benefits derived from after-school programs Identify financial proxies Return on Investment Framework (Apply Crosswalk) Apply study data to proposed cost-benefit crosswalk to create formulas for assessment

32. Crosswalk A Effect of After-School Programming B Range of Benefits C Overall Formula

33. Effect of After-School Programming Increased Retention Rates Increases in Attendance Increased Graduation Rates Delinquency Prevention

34. Range of Benefits School-based System Savings Increases in School-based Earnings Individual Earnings Reduction in societal costs

35. Preliminary Cost Analysis Results An investment of $23.7 million provides support to 17 out-of-school time organizations in Harris County, Texas, employing 141 full-time and 465 part-time Houstonians, while providing activities and services to 41,367 participating youth grades prekindergarten through 12 th grade.

36. Preliminary Findings $4.58 return for every dollar spent on afterschool programs

37. Evaluating the Out-of-School Time Needs, Resources, and Initiatives in the Communities of Houston Modifications Focusing only on necessary data elements Data collection plan will capture higher percent of funding for programs Stronger relations with school-age childcare community.

38. Evaluating the Out-of-School Time Needs, Resources, and Initiatives in the Communities of Houston ENRICH Successes: Robust Dissemination Plan Community mobilization City of Houston now invests over $500,000 in after-school programming

39. Evaluating the Out-of-School Time Needs, Resources, and Initiatives in the Communities of Houston Thank You! Lisa Thompson Caruthers, MSW, Ph.D. lcaruthers@hcde-texas.org 713.696.1336 www.afterschoolzone.org @Afterschool4HOU

40. Questions?  To submit live questions, please use the “Questions” box on the control panel

41. Jen Rinehart, Vice President, Research & Policy, Afterschool Alliance

44. 44 W E C AN H ELP T ELL Y OUR S TORY

45. Better Together: A Resource Directory for Afterschool System Builders Available online at http://www.aypf.org/better-together-a-resource-directoryhttp://www.aypf.org/better-together-a-resource-directory The Directory Includes: A comprehensive listing of over 50 organizations Resources categorized by key themes Easy access to relevant information, data, and briefs

46. Please fill out the survey upon exiting the webinar. Your feedback is important to us! To learn more and access copies of the slides and event recording, please visit www.aypf.org www.afterschoolalliance.org THANK YOU! @afterschool4all