1. Planning for Effective Health Promotion Evaluation Bernie Marshall School of Health and Social Development Deakin University bernie.marshall@deakin.edu.au

2. Evidence in health promotion Acting on the evidence evidence-based practice Generating evidence Accountability Judgements - effectiveness, worth, value Improving practice – ours and theirs Making the case for health promotion – we are competing against illness treatment

3. Evaluation Resource Works from DHS planning frameworks and the IHP guide Evaluation planning grid Case studies Agency – mental health Catchment – physical activity Additional guides and resources for evaluation

4. Integrated health promotion planning and evaluation

5. Organisational HP planning template

6. Planning health promotion programs Health issue Determinants Actions on priority determinants of the issue Goal Objectives Strategies Long term change Intermediate term change Short term change

7. Evaluating health promotion programs Health issue Determinants Actions on priority determinants of the issue Goal Objectives Strategies Outcome evaluation Impact evaluation Process evaluation

8. When do I use each type? Process evaluation – use during the life of the program. Includes participant satisfaction, quality of materials, quality of delivery etc Impact evaluation – use at the completion of specific project stages (i.e. after sessions, at monthly intervals and/or at program completion) Outcome evaluation – not often used by P&CH sector but include reductions in incidence/prevalence of health conditions, changes in mortality, improvements in quality of life, long-term changes in behaviour (eg smoking rates)

9. Evaluation planning grid

11. New evaluation planning grid

12. Case studies Examine either of the mental health or the physical activity case study. What information is there in the case study? What did you find of use in it?

13. Evaluating your own programs Think of a program that you currently need to evaluate Identify one objective and its impacts – on the worksheet We will now design the evaluation of this objective and its impacts.

14. Making objectives SMART S pecific: clear and precise M easurable: amenable to evaluation A chievable: realistic R elevant: to the health issue, the population group and your organisation T ime specific: time frame for achieving your objective

15. Evaluation planning worksheet Objective – is it SMART? What are the key questions that the evaluation should answer Being strategic, rather than doing reach evaluation on every single intervention within a program Bigger picture questions – eg sustainability, who is missing out What information do we need in order to answer these questions? How will we get this information – who, when, how? Planning for analysis, reporting and dissemination Budget – being realistic: what can we afford to do; what does DHS expect for its investment?

16. Evaluation Resource Works from DHS planning frameworks and the IHP guide Evaluation planning grid Case studies Agency – mental health Catchment – physical activity Additional guides and resources for evaluation