Evidence Based Practice In the Community Sector Presentation to Leadership Network Friday 30 September 2016 Jenny Tilocca, Communities for children FP, Rosemeadow/Ambarvale, The Benevolent Society Randa Warda , Communities for Children FP, Fairfield, The Smith Family Communities for Children Facilitating Partner Initiative is funded by the Australian Government

Overview Evidence based and evidence informed practice Creating an evidence base for our work Using an evidence base Communities for Children FP model CFCA Evidence Based Programs Other Evidence Based Programs Would you like to submit your own program? Randa - 2 mins

Evidence Based and Evidence Informed Practice "Evidence-based practice" is a term that was originally coined in the field of medicine in the 1990s. Since then, it has been increasingly adopted by the helping professions and defined in this context as the point of overlap between best evidence, practitioner expertise and client values (Gibbs, 2003). The move to increase Evidence Based programs across the Child, Youth and Family sector look to improve outcomes and quality of living. The united delivery of Evidence Based programs from government agencies like the Department of Social Services (DSS) and Family and Community Services (FACS) along with the changes in the funding available to non government agencies (NGO’s) will ensure consistency and outcome focused practice and service delivery. Jenny– 15 mins for slides 3 - 5

Evidence Based and Evidence Informed Practice What does this mean? Evidence based / informed practice Evidence informed practice is used to design programs and activities using information about what works. It means using evidence to identify the potential benefits, harms and costs of any intervention and also acknowledging that what works in one context may not be appropriate or feasible in another. Evidence informed practice brings together local experience and expertise with the best available evidence from research (http://www.dhhs.tas.gov.au/wihpw/principles/evidence_informed_practice Evidence Based Program These are programs that have demonstrated the highest level of evidence of effectiveness based on the criteria below. These programs, if implemented with adherence to the program developer’s model, are likely to produce positive outcomes. Effectiveness demonstrated in rigorous scientific evaluations Effectiveness demonstrated in large studies with diverse populations or through multiple replications Significant and sustained effects http://www.episcenter.psu.edu/ebp/definition Jenny

Creating an evidence base Competing resources and priorities have increased the need to demonstrate the outcomes interventions have achieved. It is important we plan evaluation carefully before programs begin so we incorporate information from the outset; evaluating at all stages helps to build the evidence base. Consultation & research: Consultation: how are consultation results captured? (qualitative - quantitative) Research: primary data (at community level) and secondary data (at population level) What if you don’t have researchers on your team? Example of validated tools and models : Results Based Management Model Getting To Outcomes™ 2004 Jenny Where do we start? Get group to reflect and report back on how they are capturing results now.. what methodology they currently use? Are you doing surveys, focus groups forums to evaluated

Using an evidence base Evaluation & measurement methodology Agree on outcome/s = Program Logic Why a program logic? Program logic is a critical element in an evaluation because it sets out a graphic and easily understandable relationship between program activities and the intended outcomes of the program. Jenny – 15 mins for slides 6 - 7 You need to look at what type of evaluation measurements to use. Mapping Backward – outcomes –

Using an evidence base Deciding which tools to use to measure outcomes for your program relies on clearly identifying what you will measure (e.g. attributes, behaviours, feelings, skills) and then framing these concepts in a way that is measureable Design an outcomes tool that is specific to your organisation or use a universal one. https://aifs.gov.au/cfca/2016/04/14/how-choose-outcomes-measurement-tool Strengths and Difficulties Questionnaire (SDQ) The Parent Empowerment and Efficacy Measure (PEEM) Conduct your evaluation: minimum sample size, baseline + 2 post measures; evaluation report - findings Assess evaluation reports against intended outcomes. Jenny You need to look at what type of evaluation measurements to use. Activity: map what you already do, or would be do-able within your current practice What works for your organisation available resources

Evidence Based Practice In the Community Sector Presentation to Leadership Network Friday 30 September 2016 Mornin tea break Jenny Tilocca, Communities for children FP, Rosemeadow/Ambarvale, The Benevolent Society Randa Warda , Communities for Children FP, Fairfield, The Smith Family Communities for Children Facilitating Partner Initiative is funded by the Australian Government

Communities for Children FP model Communities for Children Facilitating Partner is an initiative of the Department of Social Services to respond to the needs of the most disadvantaged children 0-12 and their families across 52 sites in Australia FPs are place-based, evidence based and informed, and use early intervention and prevention methodology The 2015 reforms included: All funding is allocated to Community Partners Eligibility does not include State and other government departments Minimum inclusion of 30% Evidence Based Programs in allocation Activity Work Plan to demonstrate inclusion of EBPs in a genuine way in overall delivery and work towards Community Strategic Plan ` Randa - 15 mins for slides 8 - 10

CFCA Evidence Based Programs The Industry List Implementation place-based application working with program developers . Randa

Other Evidence Based Programs List of programmes submitted for approval by CFCA Approved programmes For national use For local use only Provisionally approved programmes Programmes currently under assessment The Families and Children Activity Industry List Randa

Would you like to submit your own program for consideration? Process for submission of program for consideration for inclusion into EBP list Assessment of Other Programmes Programme Submission Template – Word Research, evaluation and Expert Panel project resources Assessment Criteria Theoretical background Program Logic or Theory of Change Program Activities Program Evaluation Program Staffing Randa – 15 mins

Contact details Jenny Tilocca Team Leader Child & Family Services (Community Programmes) Child & Family NSW Regional, Rural and Outer Sydney The Benevolent Society 2 Mowbray Way Rosemeadow NSW 2560 T    02 4629 2000 M  0427 881 491 Jenny.Tilocca@benevolent.org.au   Randa Warda Project Manager Communities for Children Facilitating Partner - Fairfield The Smith Family 2/11 William Street, Fairfield, NSW 2165 Tel 02 9728 6786 Mob 0412 087 332 Randa.Warda@thesmithfamily.com.au