OUTCOME MONITORING A Short Review Nidal Karim

What is Outcome Monitoring? WhatHowWhyWhen The routine process of monitoring whether or not service recipients achieve outcomes consistent with established objectives for how much they will improve on particular measures

What When How Why Identify what components of a program are working and which ones are not Help improve program effectiveness

1.Knowledge3.Beliefs 2.Attitudes4.Behaviors 5.Intentions What How WhyWhen What Do You Know About HIV and AIDS and other Sexually Transmitted Diseases? Please circle the best answer (either “True” or “False”) to each statement below. If you do not know please take a guess. 1. Condoms aren’t needed as long as a sex partner looks healthy. True False 2. Vaseline is the best lubricant (lube) to use with a latex condom to prevent HIV. True False 3. Pulling out before you cum is as good at preventing HIV as using a condom. True False 4. In terms of risk for HIV, oral sex is less risky than anal sex. True False About how many times in the last 1 month have you had each of the following types of sex? (if none, please fill in “0”) Oral ________ times How many times did you use protection (e.g. condom)? _______ times Anal _______ times How many times did you use protection (e.g. condom)? _______ times Vaginal ______ times How many times did you use protection (e.g. condom)? _______ times How many different sex partners have you had in the last 1 month?_______ partners Of these different partners, how many did you not know their HIV status?_____ partners The next time you have an opportunity to have sex, how likely is it that you will ……. 1 Not at all Likely 2 Somewhat Unlikely 3 Unsure 4 Somewhat Likely 5 Very Likely N/A Does not Apply a. Ask your partner to/or tell them you will pull out before cumming b. Ask your partner for oral instead of anal sex c. Tell your partner “no” or refuse sex if they won’t use a condom d. Ask your partner to use a male or female condom e. Ask your partner to engage in non-penetrative sex (e.g. mutual masturbation) rather than oral or anal sex These questions ask you about how you view yourself and how you feel about others view of you. Please mark N/A if the question does not apply to you. Strongly Disagree DisagreeNo Opinion AgreeStrongly Agree N/A a.I will never be able to accept that I have sex with men until all of the people in my life have accepted me N/A b.I often wonder whether others judge me for having sex with men N/A c.Gay lifestyles are not as fulfilling as straight lifestyles N/A d.I can't feel comfortable knowing that others judge me negatively for having sex with men N/A e.Being a gay or bi man makes me feel insecure around straight people N/A Strongly Disagree DisagreeNo Opinion AgreeStrongly Agree a.HIV/AIDS is scary to me b.I think that my risk for getting/transmitting HIV depends on the kind of sex (oral or anal) I have c.I think that my chance of getting/transmitting HIV is high if I have unprotected sex with a lot of partners d.I believe that my chance of getting/transmitting HIV is high if I have an STD e.It is likely I could get/transmit HIV/AIDS given my behaviors The next questions ask about your attitudes. If you are not currently sexually active, indicate how you think you would feel if you were to become sexually active. 1=Strongly Disagree 2=Disagree 3=No Opinion/Unsure 4=Agree 5=Strong Agree How strongly do you disagree or agree with the following statements?

What How Why When Pre: Immediately before the intervention Post: Immediately after the intervention Follow-up: Several weeks/months after the intervention

What When Why How STEPS 1. Determine purpose and uses 2. Develop measurable outcome objectives 3. Collect/gather credible evidence 4. Analyze information & develop conclusions 5. Report findings

What When Why How Step 1 Determine Purpose and Uses Who will use the information? What is the primary purpose of the information? How will the information be used? Purpose To asses client progress To understand differences among subgroups To determine factors that contribute to client’s progress Use To improve program implementation To create a context for understanding effectiveness

What When Why How EXAMPLE Objective 1: 80% of clients will express the intention to engage in two or more risk reduction behaviors immediately after completing the program Objective 2: 75% of clients will report having used two or more risk reduction behaviors 1 month following completion of the program WHEN Time (date) by or during which it is to occur HOW MUCH Target rate or the amount of change FOR WHOM Refers to the target population WHAT Problem / behavior / outcome to be changed or intervention to be accomplished WHERE Area in which target population is located Step 2 Develop Measurable Objectives WHEN HOW MUCH FOR WHOM WHAT WHERE Outcome objectives are statements of the amount of change expected (for a health problem, knowledge, behavior, etc.) for a specified population within a given time frame.

What When Why How Step 3 Collect/Gather Credible Evidence Identify types of information needed Determine sources of information Select methods to collect information Define procedures to collect information Measures The observable and measurable data or item of information to be collected for a specific variable (also called indicator) EXAMPLE: Percentage of times a sexually active participant used a condom during anal sex in the last 3 months Variables Observable characteristics of a person, organization, or program that are counted and measured EXAMPLE: Condom use (risk reduction behavior) Client-Level Data Knowledge Attitudes Beliefs Behaviors Intentions Program-Level Data Morbidity Rates Mortality Rates Health Service Utilization

What When Why How Step 4 Analyze Data & Justify Conclusions Enter data and check for errors Tabulate data Analyze data by key characteristics Provide interpretation of findings The process of categorizing, ordering, manipulating, and summarizing data to obtain answers to outcome evaluation questions. Common types of errors to look for: Missing information Incomplete information Inconsistent responses Invalid responses

What When Why How Step 5 Report Findings Results of data analysis Discussion of strengths and weaknesses and implications of the results

Source: