Gathering Credible Data Seattle Indian Health Board Urban Indian Health Institute Shayla R. Compton, MPH University of Washington School of Public Health.

Slides:



Advertisements
Similar presentations
Evaluation at NRCan: Information for Program Managers Strategic Evaluation Division Science & Policy Integration July 2012.
Advertisements

Program Evaluation: What is it?
“Mixed Methods in Program Evaluation” Presented by Tom Chapel
+ Partners for Learning Assessment Exploration. + Overview Introducing Partners for Learning Assessment Exploration Sorting out what we do Finding out.
Evaluation: LTBI Contact Treatment in DC Kim Seechuk, MPH Bureau of TB Control District of Columbia.
Using Data to Measure and Report Program Impact Anne Basham, MFA MEMconsultants.
Measuring Value: Using Program Evaluation to Understand What’s Working -- Or Isn’t Juliana M. Blome, Ph.D. , MPH Office of Program Analysis and Evaluation.
How Do We Know if a Charter School is Really Succeeding? – Various Approaches to Investigating School Effectiveness October 2012 Missouri Charter Public.
What You Will Learn From These Sessions
Neighbor to Neighbor Lessons learned from a community- based HIV testing partnership: The HIV Minority Community Health Partnership Presented at American.
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 1: Getting ready.
Designing an Effective Evaluation Strategy
Orientation for New Site Visitors CIDA’s Mission, Value, and the Guiding Principles of Peer Review.
Good Participatory Practice (GPP) Guidelines for Biomedical HIV Prevention Trials Second Edition 2011.
Program Evaluation and Measurement Janet Myers. Objectives for today… To define and explain concepts and terms used in program evaluation. To understand.
An Assessment Primer Fall 2007 Click here to begin.
Health Data Roundtable Discussion Reality Check: Are You Getting the Data You Need? Urban Indian Health Institute and California Consortium for Urban Indian.
ASSESSMENT WORKSHOP: SESSION 1 ADMINISTRATIVE SUPPORT SERVICES ACADEMIC AND STUDENT SUPPORT SERVICES PRESENTED BY THE DIVISION OF INSTITUTIONAL EFFECTIVENESS.
1 Evaluation as Continuous Improvement The Health Disparities Service- Learning Collaborative Suzanne B Cashman February 27, 2007.
Title I Needs Assessment and Program Evaluation
Evaluation. Practical Evaluation Michael Quinn Patton.
1 © 2009 University of Wisconsin-Extension, Cooperative Extension, Program Development and Evaluation Collecting Data This is STEP 3 of the five steps.
University of Wisconsin - Extension, Cooperative Extension, Program Development and Evaluation Unit 3: Engaging stakeholders.
Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
Evaluation Plan March 7, General approach to evaluation is broad with the ability to support specificity. Collecting and evaluating multiple innovations.
Copyright © 2012 American Institutes for Research All rights reserved. CASEL/NoVo Collaborating Districts Initiative for Social and Emotional Learning:
How to Develop the Right Research Questions for Program Evaluation
1 Qualitative Evaluation Terms Coding/categorization The process of condensing qualitative data through the identification of common themes. Data Matrix.
Chapter 19: Mixed Methods Research
Creating a service Idea. Creating a service Networking / consultation Identify the need Find funding Create a project plan Business Plan.
Data Analysis for Evaluation Eric Graig, Ph.D.. Slide 2 Innovation Network, Inc. Purpose of this Training To increase your skills in analysis and interpretation.
ATP Online Module July 2006 Conducting Qualitative Research
Module 3. Session DCST Clinical governance
Sociology 3322a. “…the systematic assessment of the operation and/or outcomes of a program or policy, compared to a set of explicit or implicit standards.
The Evaluation Plan.
CONFERENCE EVALUATION PLANNING Good planning is essential ! (‘’fail to plan is plan to fail’’)
Assessment 101 Center for Analytics, Research and Data (CARD) United Church of Christ.
Evaluation of the Indianapolis, Indiana September 2002 – August 2003 Stamp Out Syphilis Coalition.
BC NSQIP SITE ASSESSMENT SUMMARY FINDINGS SURGICAL QUALITY ACTION NETWORK MEETING FEBRUARY 18 TH 2015.
Too expensive Too complicated Too time consuming.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
Introduction to Evaluation January 26, Slide 2 Innovation Network, Inc. Who We Are: Innovation Network National nonprofit organization Committed.
Evelyn Gonzalez Program Evaluation. AR Cancer Coalition Summit XIV March 12, 2013 MAKING A DIFFERENCE Evaluating Programmatic Efforts.
Welcome! Please join us via teleconference: Phone: Code:
Using Program Data to Improve Services Kristin Stainbrook, Ph.D. Advocates for Human Potential, Inc. Albany, NY The Center for Substance Abuse Treatment.
Quality Assessment July 31, 2006 Informing Practice.
Evaluation Overview: Rochelle Schultz Spinarski, Rural Health Solutions Community Care Learning Collaborative October 29, 2014.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Alain Thomas Overview workshop Background to the Principles Definitions The National Principles for Public Engagement What.
Copyright © 2014 by The University of Kansas A Framework for Program Evaluation.
Evaluation Approaches, Frameworks & Designs HSC 489 – Chapter 14.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Program Evaluation Principles and Applications PAS 2010.
Working With Stakeholders. Continuous Effort Stakeholder engagement is the process by which an organization involves people who may be affected by the.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Presented at the Leadership Symposium on Evidence-Based Practice in Child Welfare Services June 28, 2007 Davis, CA It Can Work! Lessons Learned from a.
Unit 9: Evaluating a Public Health Surveillance System #1-9-1.
Demonstrating the Value of Stakeholder Input for Evaluation Design, Implementation and Dissemination Yvonne Abel, MS Abt Associates Inc. AEA Annual Conference,
Yvonne Abel, Abt Associates Inc. November 2010, San Antonio, TX Enhancing the Quality of Evaluation Through Collaboration Among Funders, Programs, and.
WHY IS THIS HAPPENING IN THE PROGRAM? Session 5 Options for Further Investigation & Information Flow.
So You Think You’ve Made a Change? Developing Indicators and Selecting Measurement Tools Chad Higgins, Ph.D. Allison Nichols, Ed.D.
Welcome to the (ENTER YOUR SYSTEM/SCHOOL NAME) Data Dig 1.
Patricia I. Documét 1, MD, DrPH, Yll Hyseni 2, MPH, Edmund M. Ricci 3, PhD, MLitt, Caroline Feller 4, MS, OTR, CCM Evaluation of the Brain Injury Association.
Business Leadership Network: Program Evaluation in Public Health March 28, 2016.
Evaluating the Quality and Impact of Community Benefit Programs
Designing Effective Evaluation Strategies for Outreach Programs
Action Research Project III: ARP María del Pilar Fernández Pedraza Chía, Colombia October 14th, 2017 SUCCESSFUL STRATEGIES TO FOSTER SELF-DIRECTED.
Presentation transcript:

Gathering Credible Data Seattle Indian Health Board Urban Indian Health Institute Shayla R. Compton, MPH University of Washington School of Public Health

Urban Indian Health Institute, a division of the Seattle Indian Health Board Objectives of Session Describe how data collection fits into program evaluation Discuss general principles of data collection Discuss considerations for selecting the right data collection methods for you Overview of qualitative and quantitative data collection methods

Urban Indian Health Institute, a division of the Seattle Indian Health Board Evaluation A systematic way of collecting information about the characteristics, activities, products, and outcomes of a program. Evaluation Program Improvement AccountabilityFundraising Decision Making Public Relations Requirements Patton, M.Q. (2008) Utilization-focused evaluation (4 th edition). Thousand Oaks, CA: Sage.

Urban Indian Health Institute, a division of the Seattle Indian Health Board Evaluation Framework Engage stakeholders Describe the program Focus the evaluation design Gather credible evidence Justify conclusions Ensure use and share lessons learned

Urban Indian Health Institute, a division of the Seattle Indian Health Board Data Collection Principles Respect for clients Clear and honest communication Ensure the evaluation is culturally responsive Address all questions or concerns Share the data with participants and stakeholders

Urban Indian Health Institute, a division of the Seattle Indian Health Board Data Collection Considerations Taylor-Powell, E. Planning a Program Evaluation (1996) What information is needed? Where is the information? How much time is needed/available? What resources are available?

Urban Indian Health Institute, a division of the Seattle Indian Health Board Qualitative vs. Quantitative Qualitative Data: Clean and tidy Bright lights Quantitative Data: Number of staff Proportion of patients that are elders

Urban Indian Health Institute, a division of the Seattle Indian Health Board Qualitative Methods InterviewsFocus Groups Creative Expression & StorytellingParticipant Observation

Urban Indian Health Institute, a division of the Seattle Indian Health Board Quantitative Methods Observation Checklists Document Review Surveys Tests Biomedical Markers

Urban Indian Health Institute, a division of the Seattle Indian Health Board Mixed Method Approach Qualitative Method Quantitative Method Credible Data Gathered Focus Groups Interviews Document Review Surveys

Urban Indian Health Institute, a division of the Seattle Indian Health Board Mixed Method Approach: Triangulation Quantitative Data & Results Qualitative Data & Results Interpretation

Urban Indian Health Institute, a division of the Seattle Indian Health Board Selecting the Best Method Data Collection Method How we collect the information to answer our question Indicators What we examine Evaluation Question What we ask

Urban Indian Health Institute, a division of the Seattle Indian Health Board Practice & Review Process Objective: Recruit 150 youth to participate in GONA. Evaluation Question How effective were outreach efforts in engaging youth in GONA? Indicators Attendance Where participants heard about the event Types of outreach conducted Number of flyers posted, listserv postings

Urban Indian Health Institute, a division of the Seattle Indian Health Board Practice & Review Attendance logs Summary reports Outreach materials Social media activity

Urban Indian Health Institute, a division of the Seattle Indian Health Board Practice & Review Outcome Objective: 30 days after discharge, clients released from residential substance abuse treatment will report implementing stress management skills not involving alcohol or substance abuse. Evaluation Question How are clients managing stress post discharge? Indicators Identified coping skills for managing stress Perceived strengths and weaknesses of programs offered post- treatment

Urban Indian Health Institute, a division of the Seattle Indian Health Board Practice & Review Multiple perspectives Direct feedback

Urban Indian Health Institute, a division of the Seattle Indian Health Board Summary Respect for clients & community Choose the method that best fits your evaluation question, the source of information, and resources (financial, expertise, time, etc.).

Urban Indian Health Institute, a division of the Seattle Indian Health Board Questions Contact Julie Loughran at or to receive individualized consultation on program 26

Urban Indian Health Institute, a division of the Seattle Indian Health Board Data Collection Resources American Indian Higher Education Consortium Creative Narrations National Science Foundation Northwest Center for Public Health Practice University of Wisconsin-Extension

Urban Indian Health Institute Seattle Indian Health Board th Avenue South Seattle, WA Phone: (206) Fax: (206) Website: