1. Evaluation Tools and Models Northern Plains CCC Program Comprehensive Cancer Control 2008 Annual Grantee Meetings May 14th, 2008 Atlanta, GA

2. Northern Plains Comprehensive Cancer Control Program Logic Model InputsOutputs ParticipationActivities Outcomes - Impact Short TermMedium TermLong Term Funding – CDC and other resources Staff: ~2 full time Coalition and Partners Current data and research Conference calls and meetings with Coalition and partners Educate community Create Strategic Plan Improve cancer data Engage tribal community for support Tribal Leadership Health Professionals Cancer Organizations Cancer Survivors Tribal Health Workers Media State Cancer Programs Increased knowledge and awareness of cancer prevention and control Increased numbers of cancer activities in tribal communities 1-3 years4-6 years7-10 years Increased skills and capacity to address cancer Increase in cancer screening accessibility Change in risk factors for cancer Increased cancer treatment resources and support Increase in cancer survivor and caregiver support systems Increase in treatment follow-up Decreased Cancer Incidence Rates Decreased Cancer Mortality Rates Increase in Quality of Life for Cancer Patients Implement cancer control activities/interv entions Indian Health Service employees Cancer Researchers Increase in cancer screening rates Improved data and surveillance Increased support from key partners Improved cultural sensitivity/compe tency

3. Strategies Tracking Data of Coalition and Partnerships (meeting participation, agendas, rosters, etc.) Partnership Satisfaction and Needs Assessments Pre and Post Assessments Cancer Burden and Risk Factor Surveillance Evaluate absolutely every activity or intervention… –somehow….if we can…

4. Tools Audience Response System (ARS) Online Evaluation Database

6. Sample Question: What do you like most about this meeting? 1.Presentations from my peers and colleagues 2.Poster Session 3.Free candy and pens 4.Doing the chicken dance 5.I don’t know/I’m not sure

7. How we are using ARS? Short-term Outcome: Increased knowledge and awareness of cancer prevention and control –Cancer 101 Workshops –Education Conference –Community Colorectal Cancer Workshop –Family Caregiver Workshop

8. ARS Advantages Knowledge, Attitude, Belief, Satisfaction outcomes from workshops, meetings, etc. Efficient data collection, analysis, reporting Better response rate than paper surveys Mostly well-received in communities Can help facilitate group processes

9. ARS Disadvantages Cost….? Technology Portability (ARS unit and staff) –Community Grant Example Does not measure knowledge retention or outcome in behavior

10. Online Evaluation Database

11. Password protected system Upload ARS, tracking, evaluation data Automatically generate reports and summarize data Tabs for different inputs: Committees, Partnerships, Products, Dissemination, etc.

13. Online Evaluation Database Advantages Provides external consultants/partners access Easier to generate reports Uniform measures and comparison Partners information/data? »……at least we hope……

14. Online Evaluation Database Disadvantages Technology You only get what you put in… –Cancer Burden Data Time and resources to upload data and maintain site Appropriate data-sharing What will we miss?

15. Evaluation Plans Update and Revise Evaluation Plan Continue to improve use of ARS Tailor and begin using Online Database Northern Plains Cancer Data Improvement Initiative