Altarum Institute integrates independent research and client-centered consulting to deliver comprehensive, systems-based solutions that improve health and health care. A nonprofit, Altarum serves clients in both the public and private sectors. For more information, visit Evaluation Overview State Alliance of Michigan YMCAs Michigan Health Endowment Fund Project Kara Wise Altarum Institute August 25, 2015

2 Objective  Provide an overview of evaluation plans and timeline for the MHEF project.  Discuss the Progress Report Survey

3 Data Collection and Analysis Methods  Mixed-methods approach using a combination of instruments to gather the best mix of quantitative data and qualitative data for context  Surveys  Interviews  Site Visits  Document Review  Analysis using SPSS and Nvivo (qualitative analysis software to analyze by theme)

4 Evaluation Reporting Timeline  September st Progress Report Survey  September 24, 2015 – Training for HEPA Mobile app  December 2015/January nd Progress Report Survey  February 28, Interim Report  If additional information is needed to complete the Interim Report, there is potential for select YMCAs to complete key informant interviews, site visits and/or document reviews.  Year 2 Evaluation Timeline- TBD  Evaluation will include: Progress report surveys Key informant interviews Site visits Document review  January 5, Final MHEF Project Report

5 Progress Report Survey In Depth  Who- All Y grantees must complete the progress report survey.  What- A web-based survey we will use to assess progress made for your project. The survey addresses all areas- HOST, Michigan Swims, and Healthy Living Capacity Building.  When- You will be ed a link to complete the survey in September. You will have 2 weeks to complete the survey.  Where- The survey must be completed online.  How- Work with partners and staff to gather information and assess site practices as necessary to provide the most accurate information possible.

6 Progress Report Survey In Depth- Why?  To collect data in a systematic manner so that we can have the same types of information about your activities despite variability in programming.  To measure the progress made throughout your programming from baseline reporting (Work Plan Survey).  Have all sites started conducting proposed programming/activities? If no, why not?  To assess programming processes such as:  Enrollment numbers  Successes and barriers to program implementation  Lessons learned

7 Progress Report Survey- HOST  2 Sections: Summer programming and school year programming  Topic areas (most data to be collected at site-level):  Program operational characteristic updates  Student Reach/Enrollment  Curriculum being implemented and number of lessons taught  Compliance implementing HEPA standards  Successes, challenges to date

8 Progress Report Survey- Michigan Swims  Topic areas:  Program operational characteristic updates  Student reach/enrollment  Current partnerships  Successes, challenges to date

9 Progress Report Survey- Healthy Living Capacity Building  3 Sections: EnhanceFitness, Moving For Better Balance, YDPP  Topic areas:  Program operational characteristic updates  Project Enrollment  Staff training  Status of planning and/or implementation efforts  Successes, challenges to date

10 Progress Report Survey FAQ  What will you do with this information?  We will use this information to compare your progress against baseline reporting from the Work Plan Survey completed in May  Will I receive my results?  Yes, you will receive a copy of the data you inputted. Additionally, the results from this progress report and the 2 nd progress report conducted in December 2015/January 2016 will be combined and presented in the MHEF Project Interim Report- February 28,  What if I have not conducted proposed program activities yet?  There will be an opportunity for you to report on program processes such as a delay in programming as well as barriers to implementation.

11 Progress Report Survey Tips  Do not leave answers blank or provide incomplete information. If you don’t complete all of the information, we will still have to get it from you and this delays the process.  Do not tell us what you think we want to hear- Be truthful about progress made to date. This information is vital to accurately reporting and evaluating your site’s programs.  If you don’t know how to answer a question because you don’t understand it or it doesn’t seem to fit with your Y’s activities, seek guidance on how to respond instead of guessing.  If you don’t have all of the details being asked, do your best to work with partners and staff to figure details out ahead of time as best you can.

12 HEPA Mobile Plans for the MHEF Project  Michigan will be piloting the use of HEPA Mobile app:  September - December 2015  We will encourage each site to complete each checklist 1x/week or more  Single site and multi-site versions available  Training on app scheduled for September 24  Sites can begin entering data after training

13 Questions?

14 Kara Wise, MPH Senior Policy Associate Center for Healthy Child and Youth Development Altarum Institute 3520 Green Court, #300 Ann Arbor, MI (734)