1. Online Learning Module: Planning evaluation

2. Webinar overview  This webinar will be recorded so that it can be available on the Centre’s website as an educational resource  The slides and any supplementary materials will be sent to participants at the end of the session  The session will take approximately 45 minutes including time for questions  You may ask questions or make comments by: Typing your question or comment

3. What is the Centre? Knowledge Bringing people and knowledge together to promote the best mental health and well-being for every child and youth CapacityPartnerships Full continuum of effective and accessible mental health services for children and youth.

4. Introduction  Facilitator: Lindsey Thomson, Research Associate  Today’s webinar: Brief overview of Module 1: Planning Evaluation ◦Will also provide information on the associated ‘Toolkit’ for planning evaluation

5. Strengths of Online Learning Modules  Active Learning: Case studies Scenarios Quizzes  Build a common language around evaluation  Good idea to view modules with colleagues and work through exercises together

6. Module 1: Learning Objectives  Define evaluation  Distinguish between types of evaluations  Identify possible benefits and challenges  Outline and describe key elements of an evaluation framework

7. Types of Evaluation  Process Evaluation: Focuses on the development, implementation, and/or delivery of a program E.g. What is the average wait time for a program?  Outcome Evaluation: Extent to which a program has been successful in achieving the goals/results/objectives E.g. To what extent did the program reduce family conflicts?

8. Benefits and Challenges Benefits to evaluation:  Identify aspects of program that are working well and those to be improved  Opportunities to share best practices and lessons learned with others Challenges to evaluation:  Investment of time and resources  Varying levels of staff experience with evaluation  Clients may be reluctant to participate

9. Preparing your Agency for Evaluation http://www.partnershipsforolderadults.org/resources/leveltwo.aspx?sectionGUID=e601e0c7-f9d5-4ae0-8ffc-3d69e632c605  Clarify program purpose and objectives  Identify and engage key stakeholders  Setup evaluation team and identify key roles  Conduct a literature review  Consider investment of time and strategies to reduce time invested

10. Preparing Your Agency for Evaluation Con’t… a.Logic Model b.Measurement strategy c.Indicators d.Existing data collection sources e.Data collection tools/methods f.Responsibility for data collection g.Timeframe for data collection h.Analysis plan i.Plan for sharing findings j.Plan for using findings Develop an Evaluation Framework/Plan:

11. Planning, Doing, and Using Evaluation Toolkit  Module 1: Provides conceptual understanding of planning evaluation  Planning, Doing, and Using Evaluation Toolkit: Offers guiding materials such as checklists, templates, and explanations for various tasks involved ◦E.g. stakeholder engagement, developing a logic model, identifying evaluation questions, budgeting, choosing methods, etc. * The Centre is currently working on making worksheets more user friendly! (PDF format will be changed to Excel or Word)

12. Questions? Lindsey Thomson Research Associate 613.737.7600 x3483 lthomson@cheo.on.ca www.onthepoint.ca