Christiana Noestlinger & Bea Vuylsteke, Institute of Tropical Medicine, Belgium This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within the framework of the Health Programme.

Evaluation of Quality Action Evaluation team (WP 3): – Institute of Tropical Medicine, Antwerp, Belgium – University of Applied Sciences and Arts Northwestern Switzerland, School of Social Work (FHNW) Input from other WPs Data output to other WPs

WP5: Capacity Building WP6: Practical Application WP7: Principles and Criteria WP8: Policy Development WP4: Tools

WP5: Capacity Building WP6: Practical Application WP7: Principles and Criteria WP8: Policy Development WP4: Tools

Specific objectives of the project and the evaluation Coordination and dissemination Starting environment Final evaluation SO 1:Develop a training package Evaluation of new tools SO2: Ensure level of knowledge and skills of trainers/facilitators Evaluation of knowledge and skills of trainees SO3: Support 80 tool applications Satisfaction with facilitators Level of success of the applications Perceived level of quality improvement SO4: Develop a charter for quality in HIV prevention Endorsement and signing of the charter SO5: Produce policy statement and strategic actions Level of QA/QI included in national HIV strategies

Evaluation objectives and data collection instruments Starting environment questionnaire (QAN) Topic guide for kick- of interviews (QAL) Starting environment Final evaluation Evaluation of new tools Training questionnaire (QAN) Topic guide for interviews/FGD during training workshops part 2 (QAL) Evaluation of knowledge and skills of trainees Practical application questionnaire (process and outcome) (QAN) Satisfaction with facilitators Level of success of the applications Perceived level of quality improvement Endorsement and signing of the charter Final questionnaire (QAN) Topic guide for final interviews (QAL) Level of QA/QI included in national HIV strategies

InstrumentParticipantsTimingMethod Starting environment questionnaire Stakeholders of the project 2 weeks before Kick-off workshop On-line, semi- anonymous Training questionnaire Participants of European level training workshops Pre- and post- training, part 1 and part 2 workshops On-line, anonymous Practical application questionnaire Partners applying a tool Process: max 6 weeks after application Outcome: 6 months after application On-line, anonymous Final questionnaireStakeholders of the project 2 weeks before concluding conference On-line, anonymous Data collection instruments: quantitative

InstrumentParticipantsTimingMethod Topic guide for interviews (open- ended) Stakeholders of the project During the Kick- off workshop Face-to-face interviews; audio-taped; inductive analysis Topic guide for focus group discussions (open-ended) Participants of European level training workshops During part 2 European level training workshops Focus Group discussions with trainees; transcription; inductive analysis Topic guide for interviews (open- ended) 7 trainers of the European level training workshops During part 2 European level training workshops Face-to-face interviews; audio-taped; inductive analysis Final interviews (open-ended) Stakeholders of the project During the concluding conference Face-to-face interviews; audio-taped; inductive analysis Data collection instruments: qualitative

Timeline evaluation instruments Oct-Nov 2015 Sept-Oct 2014 June 2014April 2014 May – June 2013 Starting environment questionnaire Training questionnaire (part 1) Training questionnaire (part 2) Application questionnaire (process) Application questionnaire (outcome) Final questionnaire Starting environment interview Focus group trainees Interviews trainers Final interview

Other data collection for monitoring and evaluation Process and output indicators: routine data monitoring systems – meeting minutes – internet pages – reports, tracking forms, etc. Process evaluation of selected activities: feedback forms – Kick-off workshop – Concluding conference

Guiding principles Participatory Not invasive Existing forms (other WPs) User friendly on-line questionnaires Confidentiality Anonymity

Summary Evaluation is a cornerstone of the Quality Action Not a simple before-after activity Combination of methods Input of partners crucial Findings serve as a basis to (partially) develop quality principles and criteria for the charter