Communicating Evaluation Results CENTER FOR RESEARCH STRATGIES www.crsllc.org March 2014
ReferencesReferences This presentation adapted from the following sources: Israel, B.A., Eng, E., Schulz, A.J., Parker, E.A. Editors. Methods in Community-Based Participatory Research for Health. San Francisco. Jossey-Bass, 2005. Patton, M.Q. Utilization-Focused Evaluation: the New Century Text, 3 rd Edition. Thousand Oaks. Sage Publications, 1997. Wholey, J.S., Hatry, H.P. and Newcomer K.E. (Editors). Handbook of Practical Program Evaluation. San Francisco. Jossey-Bass, 1994. Morris L.L., Fitz-Gibbon C.T., Freeman M.E. How to Communicate Evaluation Findings. Los Angeles. Sage Publications. 1987.
OverviewOverview What is the purpose for reporting your results? Who are the audiences to be reached? What type of evaluation report best suits your needs?
Purpose of Reporting What is the purpose or desired outcome of your report? Progress update Share information Obtain or sustain funding Change or develop new policy
Tips to Help Audiences Listen Communicating results is the responsibility of the program, not the audience Know your audience so your reporting is relevant to them Keep it simple Focus on actions Report in different ways
Who is Your Audience? Intended users are people, not the organizations they represent Program participants are a critical audience Pay attention to decision makers who care about the findings (e.g. current, potential funders, policy makers) **Involve users in the evaluation process** CBPR reference: http://www.cbpr-training.orghttp://www.cbpr-training.org
What Does Your Audience Want to Know? What do they want to know? (Hint: ask them) I WOULD REALLY LIKE TO KNOW ____ ABOUT ________[program] What reporting formats and style will take their viewpoints into consideration? When should you plan to deliver your results?
Types of Evaluation Reports Written reports Face-to-face briefings Photovoice Videos
Types of Written Reports Technical Report 20+ page comprehensive report Popular Article Short 1-2 page summary article or success story Issue Brief Neutral 5-6 page summary report about what is known about a particular issue or problem Brochure Contains written text and visuals
Audiences for Written Reports Technical Report- funders, program administrators, advisory committees, boards Popular Article- administrators and board members, community groups, program clients, service providers or outside organizations. Issue Brief- educated generalists such as legislators or managers who may not know much about the topic Brochure- large groups of targeted users such as policymakers or the general public
Writing Reports Begin with highlights of findings or summary of most important points Think about the visual appeal of the report Make your report readable
Improve the Readability of Your Report Simplify. Report key findings Limit generalizations. Avoid overarching statements Focus on actions. Use active verbs; think about how your results can be used Check vocabulary to make sure you use familiar words Cut unnecessary words or phrases Short sentences and paragraphs Personalize text
Project Proposal Writing by Neil Kendrick Project Proposal Writing by Neil Kendrick Empowerment Learning Development Training www.projectproposalwriting.org
Face-to-Face Briefings Step 1: Prepare your materials ahead of time Step 2: Set the stage to decide who will deliver the briefing, prepare agenda, practice Step 3: Deliver the briefing.
Step 1: Prepare Materials Charts (stand alone or within powerpoint) Large enough to be read 30 feet away Concise summary with few words Informative to convey information by themselves Written Documents High quality with use of colors, neat lettering, no typos Helpful to the presenter, designed to guide Handouts that contain duplicates of charts plus any additional items that may be discussed
Step 2: Set the Stage One or more presenter Invite a small audience when appropriate Practice Prepare written agenda Step 3: Deliver Briefing Explain purpose Grab attention immediately Be informative, yet understandable (no jargon) Be true to life, professional, balanced Interact
Visual Techniques Elicit emotion and give audiences a closer feel of local reality. Two examples: Photovoice Video
Photovoice A method where community members use cameras to take pictures of their lives and experiences A slideshow that incorporates pictures and words depicting the community. Members highlight key “take-aways”. A visual approach to identify opportunities for change or to illuminate findings that can be presented to policy makers and decision makers. References: Wang, C.C., Burris, M.A. Empowerment through photo novella: Portraits of participation. Health Education Quarterly, 21(2), 171-186. Wang, C.C. Photovoice: A participatory action research strategy applied to women’s health. Journal of Women’s Health, 8(2), 185-192.
VideoVideo Two ways to use video: To tape local conditions, people, operations and play it as part of your presentation. To tape a presentation for people to view later. Note: It is always important to obtain permission with written consent from those who appear in photographs or videos.
Thank You! We have a few brief questions to ask you about next steps. Please click on the link below and take 2 minutes to answer. We appreciate it! Communicating Evaluation Results Evaluation