1. M&E for Accountability & Global Progress Tracking
Monitoring, Operations Research and Evaluation Team
UNAIDS/Geneva
April 2007

2. ORIENTATION 2008 UNGASS Country Progress Report
Benefits of UNGASS for M&E strengthening
UNGASS Guidelines
Purpose and use
Core indicators
Data sources & data vetting
Reporting process

3. UNGASS Reporting Timetable
INTRODUCTION
Where does UNGASS fit in M&E system?
UNGASS Reporting Timetable
Use of 2006 UNGASS data
Global use
Country use

4. WHERE DOES UNGASS FIT IN A COMPREHENSIVE M&E SYSTEM?
Benefits of UNGASS reporting for M&E strengthening:
Brings partners together around a core set of indicators
Helps identify data gaps & data quality issues
Stimulates the establishment of a centralised database of HIV indicator data
Provides a de facto bi-annual report on the epidemic and the response

5. WHERE DOES UNGASS FIT IN A COMPREHENSIVE M&E SYSTEM?
Program
Improvement
Share
Data with
Partners
Reporting/
Accountability
[UNGASS, other]

6. UNGASS REPORTING TIMETABLE
REPORT REQUIRED?
2003
Yes
2004 No
2005
Interim report from a subset of countries
2006
2007
2008
2009
2010

7. GLOBAL USE OF 2006 UNGASS DATA
Global Progress Report
Report to the Secretary General (as required in the Declaration of Commitment)
Used for tracking the Millennium Development Goals

8. COUNTRY USE OF 2006 UNGASS DATA
1. National report on the epidemic and response
informs programmatic decisions
guides reviews of the National Strategic Plan
informs resource mobilisation efforts (e.g. GFATM proposal development)
is used as an advocacy tool
is used to report progress on Declaration of Commitment to Senior Government Officials

9. COUNTRY USE OF 2006 UNGASS DATA
2. M&E system strengthening
convenes relevant partners to address a particular M&E need
identifies data gaps
assists in planning data collection efforts
identifies data weaknesses
helps mobilise resources for system strengthening
stimulates evaluation questions

10. LESSONS LEARNED FROM 2006 UNGASS REPORTING
Challenges in 2006 reporting
2006 reporting from MENA
Lessons learned from 2006 reporting
UNAIDS/Geneva-level
Country-level

11. CHALLENGES IN 2006 REPORTING
137 countries submitted a Country Progress Report
10% reported on all indicators relevant to epidemic
51% used CRIS to report indicator data
Some basic data quality issues including
incorrect indicator or incorrect indicator calculation
incomplete data (e.g. only 20% of indicators reported included the required disaggregation)
illogical values
discrepancies between data in CRIS and Report

12. Percent Range and Median of Indicators Reported
by Countries by Region - UNGASS 2006 Report
How may indicators did countries report within each region? This slide shows the range of percent reporting, i.e. if countries reported all indicators = 100%; if they reported none=0%. The median refers to the number of indicators 50% of countries reported. For example, 50% of developed countries did not report any indicators, whereas in the Caribbean, 50% of countries reported more than 80% of the relevant indicators.
The question is whether a low level of reporting is due to lack of data or something else?

13. IMPORTANCE OF DISAGGREGATED DATA
Disaggregated data is very important for understanding the epidemic and for program development.
For example, to answer the question “Are programs reaching all members of target population”?
For example, looking at safe practices in IDU, it is clear that for most countries, except Moldova and Macedonia, more women adopt safer practices than men. From a program perspective, this is important to know as messages for men may need to be tailored differently than for women. Without disaggregated data this information would not be evident.

14. LESSONS LEARNED FROM 2006 REPORTING UNAIDS/Geneva-level
The following inputs are paramount for improving
the quality of the data obtained from countries:
Revise UNGASS indicators, where necessary
Provide clear and specific Guidelines
Provide user-friendly, flexible CRIS software
Provide training on UNGASS indicators & reporting process
Provide technical support, where needed

15. LESSONS LEARNED FROM 2006 REPORTING Country-level
Ensure correct understanding of indicator definition/operands
Report all required indicators
Identify and document data sources
Provide all data and information needed for each indicator
Cross-validate data (comparison with previous years, comparison with alternate sources, etc.)
Use CRIS for indicator reporting
Double-check for data entry errors
Submit timely

16. LESSONS LEARNED FROM 2006 REPORTING
LESSONS LEARNED FROM 2006 REPORTING Country-level
LESSONS LEARNED FROM 2006 REPORTING
Address data gaps early
Seek to enhance data quality
Follow all the steps in the reporting process
Double-check accuracy and obtain consensus on all indicator values at country level before submission

17. ORIENTATION ON THE UNGASS GUIDELINES
Purpose
Target audience
Contents
Principles and process of Guidelines revision
Use of Guidelines

19. PURPOSE Provide essential information on construction
of core indicators for reporting
Ensure transparency of the reporting process
in-country
Ensure consistency of information across countries for global progress analysis
The primary purpose of the UNGASS guidelines is to provide the key constituents, who are actively involved in a country’s response to HIV and AIDS, with essential information on the core indicators that measure the effectiveness of the national response.
The Guidelines also help to ensure transparency of the in-country reporting process in terms of who was involved and how the information was obtained.
In addition, they help to ensure consistency of the information obtained from different countries so that a global analysis can be conducted of the progress made towards achieving the targets of the Declaration of Commitment.

20. TARGET AUDIENCES Government sector Nongovernmental sector
including the National AIDS Committee, Ministries (e.g. Ministry of Health, Ministry of Finance, Ministry of Education)
Nongovernmental sector
including nongovernmental organizations, faith-based organizations, people living with HIV, private sector
UN co-sponsors and donor agencies
Although it was governments that initially endorsed the Declaration of Commitment, the document’s vision extends far beyond the governmental sector—to private sector and labour groups, faith-based organizations, nongovernmental organizations and other civil-society entities, including organizations of people living with HIV

21. CONTENTS OVERVIEW Introduction p. 9-13
Implementation at National Level p
Core Indicators p
Appendices p

22. APPENDICES 1 - 9 Changes to Core Indicators
Country Progress Report template
Methodology used for the coverage survey
Consultation/preparation process for the Country Progress Report
Reporting schedule for Core Indicators
National Funding Matrix 2007
National Composite Policy Index (NCPI) 2007
Sample check-list for Country Progress Report
Selected bibliography
The Appendices are essential to developing the Country Progress Report and countries are strongly encouraged to read them and use them.

23. PRINCIPLES OF GUIDELINES REVISION
Consensus-driven process
Transparency
Consistency
Comprehensiveness
Quality
Integration within the National M&E system
Feasibility

24. PROCESS OF GUIDELINES REVISION Process of Guidelines Revision
Debriefing process
2006 Indicator performance
M&E Reference Group review
Technical working groups for each indicator

25. HOW TO USE THE GUIDELINES
Familiarize yourself with the current Guidelines & the changes since the previous round
Disseminate the Guidelines and use them to develop a collaborative in-country process
Ensure that the correct definitions are used for construction of the indicators & refer to Further Information, as needed
Use all Appendices
Ask for clarification / assistance, as needed

26. CORE INDICATORS Overview of Core UNGASS Indicators
Which UNGASS indicators to report
Changes since the 2005 UNGASS Guidelines
Core UNGASS Indicators

27. WHAT ARE CORE UNGASS INDICATORS?
Quantitative variables which provide simple and
reliable ways of measuring progress towards
achieving the Declaration of Commitment on
HIV/AIDS

28. CORE UNGASS INDICATORS
National Indicators (N=25)
Four categories:
1. National commitment and action
2. National programmes
3. Knowledge and behaviour
4. Impact
Global Indicators (N=4)
There are 2 types of UNGASS indicators: national and global indicators.
1) The national indicators are the indicators each country will have to collect data for and we will focus on these in this presentation.
2) The global indicators are designed to provide information on levels of international support for key elements of the global response and to identify trends in that support. Although National AIDS Committees or their equivalents have no direct role in reporting on the core global indicators, there is a similar process for collecting, analysing and reporting data, which is handled directly by UNAIDS and its partners.
The core UNGASS indicators consist of 25 national indicators and 4 global indicators.

29. CORE UNGASS INDICATORS: NATIONAL INDICATORS
Four categories:
1. National commitment and action
2. National programmes
3. Knowledge and behaviour
4. Impact
National level UNGASS indicators are divided into 4 categories:
The indicators on National commitment and action focus on policy and the strategic and financial inputs for the prevention of the spread of HIV infection, the provision of care and support for people who are infected and the mitigation of the social and economic consequences of high levels of morbidity and mortality due to AIDS. They also capture programme outputs, coverage and outcomes; for example, in preventing the transmission of HIV from mother to child, in providing treatment with antiretroviral therapy for those in need, and services for orphans and vulnerable children.
2) The national programme indicators cover testing, prevention and treatment.
3) The indicators on National knowledge and behaviour cover a range of specific knowledge and behavioural outcomes, including: accurate knowledge about HIV transmission, age at first sex, sexual behaviours, and school attendance among orphans.
4) The indicators for National-level programme impact, such as percentage of young people infected with HIV, focus on the extent to which national programme activities have succeeded in reducing rates of HIV infection and its associated morbidity and mortality.

30. CORE UNGASS INDICATORS: NATIONAL INDICATORS
National indicators are important for two reasons:
They are used to evaluate the effectiveness of the national response
2. They are used to provide information on regional and global trends
The national indicators are important for 2 reasons:
The national indicators can help individual countries evaluate the effectiveness of their national response, which reinforces the value of including these indicators in national monitoring and evaluation frameworks
The second reason is when data from multiple countries are analysed collectively, the indicators can provide critical information on the effectiveness of the response at regional and global levels while simultaneously supplying countries with comparative insights into the efforts of other national-level responses

31. Millennium Development Goals (MDG)
MILLENIUM DEVELOPMENT GOALS (MDGs)
Millennium Development Goals (MDG)
There are 8 MDGs:
Goal 6: Combat HIV/AIDS, Malaria and other diseases
Target: Have halted by 2015 and begun to reverse the spread of HIV/AIDS
UNGASS indicators are used to monitor progress
There are 8 MDGs. Goal 6 relates to HIV/AIDS: “Combat HIV/AIDS, Malaria and other disease”. There are two targets under this goal, the one relating to HIV/AIDS is: Have halted by 2015 and begun to reverse the spread of HIV/AIDS.

32. UNGASS Indicators to monitor MDG-6
12) Current school attendance
among orphans and
among non-orphans aged 10-14
17) Percentage of women and men
aged 15–49 who had more than
one sexual partner in the past
12 months who report the use
of a condom during their
last sexual intercourse
Four of the national indicators are also
13) Percentage of young
women and men aged 15-24
who both correctly identify ways
of preventing the sexual transmission
of HIV and who reject major
misconceptions about
HIV transmission
22) Percentage of young
women and men aged
15–24 who are HIV infected
4 of the national indicators are also Millennium Development Goal Indicators.
These four indicators relate to school attendance among orphans ,knowledge among young people about HIV, condom use, and the percentage of young people who are infected with HIV.

33. Global Indicators Amount of bilateral and Amount of public funds for
multilateral financial flows
(commitments and disbursements)
for the benefit of low- and
middle-income countries
Amount of public funds for
research and development of
preventive HIV vaccines
and microbicides
Percentage of transnational
companies that are present
in developing countries and
that have workplace HIV
policies and programmes
4) Percentage of international
organizations which have
workplace HIV policies and
programmes
The 4 global indicators are collected, analyzed and calculated at UNAIDS and its partners. They are
- The amount of bilateral and multilateral financial flows (commitments and disbursements) for the benefit of low and middle income countries.
- The amount of public funds for Research and Development of preventive HIV vaccines and microbicides.
-The percentage of transnational companies which are present in developing countries and which have HIV/AIDS workplace policies and programmes.
- Percentage of international organizations which have workplace policies and programmes.

34. Which UNGASS indicators should countries report?
No distinction between Generalized Epidemic Indicator Set & Concentrated /Low-prevalence Epidemic Indicator Set
Most national indicators are applicable for all countries
Countries are expected to "know their epidemic"
How are countries supposed to choose the national indicators?
In the previous round of UNGASS reporting, indicators were grouped into two categories according to the nature of the epidemic. The distinction between a generalized epidemic indicator set and a concentrated or low-prevalence epidemic set has not been made for this round of reporting. This is due to the fact that epidemics do not fit neatly into simple dichotomous classifications.
In 2005, for example, some countries with a generalized epidemic and a relatively high prevalence recognised that sub-epidemics in most-at-risk populations were important in their epidemic and that prevention programmes for these populations were an essential element of their national response. Rightly, these countries chose to report on the indicators for these populations in addition to the generalised indicator set.
Most of the national indicators are applicable for all countries
For this round of reporting, countries are expected to consider each indicator in light of the individual dynamics of their epidemic.
That means that each country is expected to “know their epidemic”.

35. Which UNGASS indicators should countries report?
Which UNGASS indicators should countries report? (continued)
Which UNGASS indicators should countries report?
When countries choose not to report on a
particular indicator, an explanation needs to be
provided:
Either,
The indicator is not applicable to the epidemic
The indicator is applicable, but no data is available
When countries choose not to report on a particular indicator, they are asked to provide an explanation as to why they chose not to report. This will allow for an analysis that differentiates between an absence of data, and the inapplicability of particular indicators to particular country situations. In other words, all the indicators needs to be addressed either by reporting or by an explanation of why the country is not reporting on it.

36. Which UNGASS indicators should countries report? (continued)
The indicators have to be constructed including the
required disaggregations, as outlined in the
current UNGASS guidelines
The indicators for UNGASS reporting have to be constructed as outline in the UNGASS guidelines. The data should also be disaggregated when possible, for example by sex and age.

37. Changes since the 2005 UNGASS Guidelines
Why changes?
To improve the comprehensiveness and quality of data
What changes?
See Appendix 1
There has been changes after the last round of reporting in In order to improve the comprehensiveness and quality of data to be submitted for the 2008 Global Progress Report, refinements were made to the 2005 UNGASS indicators and accompanying guidelines. Refinements were based on (1) input received from a variety of partners through an extensive debriefing process, (2) an analysis of indicator performance in the 2005 reporting round and (3) new programmatic developments. These changes are listed in detail in Appendix 1 in the guidelines.

38. Changes since the 2005 UNGASS Guidelines (continued)
Principles used in revisions
changes are based on
input received from partners
an analysis of indicator performance in the 2005 reporting round
new programmatic developments
every effort was taken to minimize changes
every effort was taken to ensure that most countries would be able to collect the data or obtain it from already existing data sources
In all instances, every effort was taken to minimize changes, since clearly it is the consistency of indicators over time that allows for the assessment of trends and progress. Additionally, extra effort was taken to ensure that most countries would be able to collect the data required for the construction of the indicator, or obtain it from existing sources.

39. Changes since the 2005 UNGASS Guidelines (continued)
Indicators added:
6) Percentage estimated HIV-positive incident TB cases that received treatment for TB and HIV
7) Percentage of women and men aged who received an HIV test in the last 12 months and who know their results
Two indicators have been added for this round of reporting. The two are the percentage estimated HIV positive incident TB cases that received treatment for TB and HIV, and the percentage of women and men aged who received an HIV test in the last 12 months and who know their results. These two are added as a because of their programmatic significance.

40. Changes since the 2005 UNGASS Guidelines (continued)
Indicators removed:
Percentage of large enterprises/companies which have HIV/AIDS workplace policies and programmes
Percentage of women and men with sexually transmitted infections at health care facilities who are appropriately diagnosed, treated and counselled
Two of the national indicators have been removed from the UNGASS set, namely:
- Percentage of large enterprises/companies which have HIV/AIDS workplace policies and programmes; and,
- Percentage of women and men with sexually transmitted infections at health care facilities who are appropriately diagnosed, treated and counselled
Workplace issues have been incorporated into the NCPI
The indicator on sexually transmitted infections (STIs) was removed because of difficulties in getting reliable data on this indicator in the previous round of reporting, not because it is not important anymore. When a new reliable indicator on STIs is developed, it will be added to the national UNGASS indicator set.

41. Changes since the 2005 UNGASS Guidelines (continued)
Indicator definition changed
1) AIDS spending
3) Blood Safety
5) Prevention of Mother-to-Child Transmission
Most-at-risk Populations: Prevention Programmes
11) Life Skills-based HIV Education in Schools
16) Higher-risk Sex
17) Condom Use During Higher-risk Sex
Some of the indicators have been revised since the 2005 round of reporting. In some cases, there were relatively minor revisions to the wording of the guidance in order to provide greater clarity. In other cases, the indicators were revised based on new programme developments, response rates to the indicator and the quality of data reported. In all instances every effort was taken to harmonise any changes made with those indicators currently in use by national governments and other development partners. The consistency of indicators over time allows assessment of trends and of progress. The list of changes to the indicators is provided in Appendix 1 in the guidelines.

42. Changes since the 2005 UNGASS Guidelines (continued)
Age range expanded
4) HIV Treatment: Antiretroviral Therapy
Composite indicator divided into its components
20) Injecting Drug Users: Condom Use
21) Injecting Drug Users: Safe Injecting Practices
Added questions
2) National Composite Policy Index

43. CORE UNGASS INDICATORS: NATIONAL INDICATORS
National Commitment and Action
Domestic and International AIDS spending
by categories and financing sources
2) National Composite Policy Index (NCPI)
Questionnaire divided into two sections:
Part A
(Government)
Strategic plan; Political support;
Prevention; Treatment, care &
support; Monitoring &
Evaluation
Part B
(Non-government)
Human rights; Civil society
involvement; Prevention;
Treatment, care & support
The two first national indicators provide information on National Commitment and Action by measuring each country’s AIDS spendings by financing source and the National Composite
Policy Index (NCPI). The NCPI is designed to assess progress in the development
and implementation of national HIV/AIDS policies and strategies. It is a questionnaire that is
divided into two parts:
Part A to be administered to government officials.
And it covers five areas:
Strategic plan
Political support
Prevention
Treatment, care and support
Monitoring and evaluation
Part B to be administered to representatives from nongovernmental organizations, bilateral agencies, and UN organizations.
Part B covers four areas:
Human rights
Civil society involvement
The overall responsibility for collating and submitting the information requested in the NCPI lies with the National Governments, through officials from the National AIDS Committee (NAC) (or equivalent) with support from UNAIDS and other partners. It is important that there is adequate representation from relevant organizations and civil society in completing the questionnaire. Appendix 7 in the guidelines provides the template for the NCPI and also gives detailed instructions on how to gather data needed for the index.

44. CORE UNGASS INDICATORS: NATIONAL INDICATORS
National Programmes
3) Percentage of donated blood units screened for
HIV in a quality-assured manner
Percentage of adults and children with advanced
HIV infection receiving antiretroviral therapy
5) Percentage of HIV-positive pregnant women who received
antiretrovirals to reduce the risk of mother-to-child transmission
The National programme indicators consist of 9 indicators on testing, prevention and treatment.
3) Percentage of donated blood units screened for HIV in a quality-assured manner
4) Percentage of women and men with advanced HIV infection receiving antiretroviral therapy
5) Percentage of HIV-positive pregnant women who received antiretrovirals to reduce the risk of mother-to-child transmission
6) Percentage estimated HIV positive incident TB cases that received treatment for TB and HIV. This indicator is one of two indicators that were added.
Percentage estimated HIV-positive incident
TB cases that received treatment for TB and HIV

45. CORE UNGASS INDICATORS: NATIONAL INDICATORS
National Programmes (continued)
Percentage of women and men aged who received
an HIV test in the last 12 months and who know their results
Percentage of most-at-risk populations who received an
HIV test in the last 12 months and who know their results
7) The second indicator that is new as an UNGASS indicator is the percentage of women and men aged who received an HIV test in the last 12 months and who know their results.
Further of the National Programme Indicators are:
8) Percentage of (most-at-risk populations) who received an HIV test in the last 12 months and who know their results
*Please note that the most at risk populations should be calculated separately for each of the most at risk populations. Most at risk populations are injecting drug users, men who have sex with men, sex workers and clients of sex workers.
9) Percentage of (most-at-risk populations) reached by prevention programmes
10) Percentage of orphaned and vulnerable children whose households received free basic external support in caring for the child
11) Percentage of schools that provided life-skills based HIV/AIDS education within the last academic year
Percentage of most-at-risk populations reached
with HIV prevention programmes

46. CORE UNGASS INDICATORS: NATIONAL INDICATORS
National Programmes (continued)
10) Percentage of orphaned and vulnerable children aged 0-17 whose
households received free basic external support in caring for the child
11) Percentage of schools that provided life-skills based
HIV education within the last academic year
7) The second indicator that is new as an UNGASS indicator is the percentage of women and men aged who received an HIV test in the last 12 months and who know their results.
Further of the National Programme Indicators are:
8) Percentage of (most-at-risk populations) who received an HIV test in the last 12 months and who know their results
*Please note that the most at risk populations are put in brackets because they should be calculated separately for each of the most at risk populations. Most at risk populations are injecting drug users, men who have sex with men, sex workers and clients of sex workers.
9) Percentage of (most-at-risk populations) reached by prevention programmes
10) Percentage of orphaned and vulnerable children whose households received free basic external support in caring for the child
11) Percentage of schools that provided life-skills based HIV/AIDS education within the last academic year

47. CORE UNGASS INDICATORS: NATIONAL INDICATORS
Knowledge and Behaviour
12) Current school attendance among orphans and non-orphans aged 10–14*
13) Percentage of young women and men aged 15–24 who both correctly
identify ways of preventing the sexual transmission of HIV and
who reject major misconceptions about HIV transmission*
14) Percentage of most-at-risk populations who both correctly identify ways of
preventing the sexual transmission of HIV and who reject
major misconceptions about HIV transmission
The Knowledge and Behaviour indicators consists of 10 indicators assessing the level of knowledge and behaviour in regards of HIV/AIDS transmission and protection. They consist of:
12) Current school attendance among orphans and non-orphans aged 10–14.
13) Percentage of young women and men aged 15–24 who both correctly
identify ways of preventing the sexual transmission of HIV and
who reject major misconceptions about HIV transmission
14) Percentage of (most-at-risk populations) who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission.
15) Percentage of young women and men aged who have had sex before the age of 15
16) Percentage of adults aged 15–49 who have had sex with more than one partner in the last 12 months.
*Millennium Development Goals indicator

48. CORE UNGASS INDICATORS: NATIONAL INDICATORS
Knowledge and Behaviour (continued)
15) Percentage of young women and men
aged who have had sexual intercourse before the age of 15
16) Percentage of women and men aged 15–49 who have
had sexual intercourse with more than one partner in the last 12 months
17) Percentage of women and men aged 15–49 who had more than
one sexual partner in the past 12 months reporting the use of a condom
during their last sexual intercourse*
The Knowledge and Behaviour indicators consists of 10 indicators assessing the level of knowledge and behaviour in regards of HIV/AIDS transmission and protection. They consist of:
12) Current school attendance among orphans and non-orphans aged 10–14.
13) Percentage of young women and men aged 15–24 who both correctly
identify ways of preventing the sexual transmission of HIV and
who reject major misconceptions about HIV transmission
14) Percentage of (most-at-risk populations) who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission.
15) Percentage of young women and men aged who have had sex before the age of 15
16) Percentage of adults aged 15–49 who have had sex with more than one partner in the last 12 months.
*Millennium Development Goals indicator

49. CORE UNGASS INDICATORS: NATIONAL INDICATORS
Knowledge and Behaviour (continued)
18) Percentage of female and male sex workers
reporting the use of a condom with their most recent client
19) Percentage of men reporting the use of a condom the
last time they had anal sex with a male partner
20) Percentage of injecting drug users reporting the use
of a condom the last time they had sexual intercourse
[continued]
17) Percentage of adults aged 15–49 who have had more than one sexual partner in the past 12 months reporting the use of a condom during their last sexual intercourse.
18) Percentage of female and male sex workers reporting the use of a condom with their most recent client
19) Percentage of men reporting the use of a condom the last time they had anal sex with a male partner.
20) Percentage of injecting drug users reporting the use of a condom the last time they had sex.
21) Percentage of injecting drug users reporting using sterile injecting equipment the last time they injected
21) Percentage of injecting drug users reporting the use of sterile
injecting equipment the last time they injected

50. CORE UNGASS INDICATORS: NATIONAL INDICATORS
Impact
22) Percentage of young women and men aged 15–24
who are HIV infected*
23) Percentage of most-at-risk populations who are HIV infected
24) Percentage of adults and children with HIV known to be on treatment
12 months after initiation of antiretroviral therapy
There are 4 indicators measuring the impact of HIV/AIDS, and provides an indication of changes in prevalence and incidence when compared to data collected in previous rounds of reporting or future rounds of reporting. The impact indicators are:
22) Percentage of young women and men aged 15–24 who are HIV infected
23) Percentage of most-at-risk populations who are HIV infected
24) Percentage of adults and children with HIV still alive and known to be on treatment 12 months after initiation of antiretroviral therapy
25) Percentage of infants born to HIV infected mothers who are infected
25) Percentage of infants born to HIV-infected mothers who are infected
*Millennium Development Goals indicator

51. DATA PROCESS FOR UNGASS REPORTING
What steps to include in the data process
Why is the data process important

52. DATA PROCESS FOR UNGASS REPORTING
Data collection, vetting, and analysis process including:
Identification of relevant tools / sources for data collection for each indicator
Timeline for data collection in line with other data collection efforts, including those via funding agencies (e.g. GFATM, PEPFAR)
Reporting timeline for facility-based data for national level aggregation
Data vetting workshops to reach consensus on the correct value for each indicator

53. DATA PROCESS FOR UNGASS REPORTING (continued)
Protocols for data processing and management including:
Basic data cleaning and validation
One database for analysis and reporting purposes
Analysis of relevant data
in coordination with partners from government, civil society
and the international community
- See Appendix 8 Sample Checklist -

54. DATA PROCESS FOR UNGASS REPORTING: the WHAT
5. Use
of Data
4. Consensus
on Data
3. Understanding
Data
Have data and related information been collected in a timely manner and collated from multiple sources for each indicator?
2. Gathering
Has a data process for UNGASS reporting
with roles and responsibilities been established
and shared with all relevant partners?
1. Planning
Have the characteristics and quality
of the available data been assessed and strengths and limitations understood?
Has a collaborative consultation with relevant partners to reach consensus on indicator values taken place and been documented?
Have a comprehensive data analysis and findings been included in the Country Progress Report, endorsed by all relevant stakeholders?
This is a step diagram which poses the questions that should be asked regarding the process of the data aspects of UNGASS reporting. Details of each step are described in a handout and should be referred to when undertaking this process
The first step is planning the process: This also includes identifying indicators and if data is available, strategies for data collection, identify sources, setting timelines, in particular timelines that are harmonized with donor and other organizational reporting and data collection timelines.
Second step is gathering data: Have data been collected from all existing sources, is there a point of contact for each of these sources for referral and clarification, is system set up to manage this data and related information (such as source, collection period, etc.)
Third step is understanding the data: This includes knowing if the data are most recent and representative, what was the methodology for collection (was it robust), what quality control assurance was taken (does data system ensure quality, was it standardized survey, was data managed in standardized way)?
The fourth step is consensus on data: Based on the results of 3. a collaborative process with relevant partners for choosing best indicator value should take place.
The fifth step is use of data: Based on a comprehensive analysis of the final indicator values, interpretation and write up should be endorsed by all relevant partners. It is encouraged that this also be a collaborative process.

55. DATA PROCESS FOR UNGASS REPORTING:
the WHY
Completeness, integrity, credibility, and consensus of indicator data is paramount for successful monitoring of the HIV epidemic & for guiding program planning, advocacy, and policy
A clear and comprehensive data process, involving all relevant stakeholders, will help ensure steps are taken to obtain the best possible data

56. DATA CONSIDERATIONS Data sources Numerators and Denominators
Data disaggregation
Recency and representativeness of data

57. DATA SOURCES Population-based surveys (e.g. DHS, AIS, MICS)
Special surveys (e.g. BSS, 2nd generation surveillance surveys, school surveys, health facility surveys)
Programme monitoring (e.g. patient tracking, Health Information System)
Key informants
Desk review
HIV surveillance / estimates 57

58. NUMERATORS AND DENOMINATORS
Most indicators have a numerator and denominator to calculate a percentage
Follow the instructions exactly
It is important that the data collection period is consistent for all the information relevant to a specific indicator’s numerator and denominator 58

59. DATA DISAGGREGATION Countries are expected to submit
total values
AND
all disaggregated values as per the instructions in the Guidelines
Data collected through facilities, programme monitoring, and surveys is often disaggregated; the challenge is to ensure the disaggregated data is also available at national level
Countries are expected to submit total values AND all disaggregated values as per the instructions in the Guidelines
As mentioned previously, less than 20% of the data submitted for the 2005 report were disaggregated, which makes it difficult to draw conclusions. It is vital that countries collect data in its component parts and not simply in its aggregated format, and to retain the disaggregated data as it moves from the local level to the national and global levels. 59

60. DATA DISAGGREGATION (continued)
Why important?
Allows for more effective tracking of resources and programmatic responses
Allows for monitoring trends in specified sub-populations
Allows for monitoring equity of access to services 60

61. IN-COUNTRY REPORTING PROCESS
Country Progress Report Format
Submission Process
Role of UNAIDS/Geneva

62. RECENCY & REPRESENTATIVENESS
Which data to submit?
Ideally,
most recent data available
nationally representative data
But,
if data is not representative, most recent survey data which has been reviewed and endorsed by technical experts within the country
The most recently available nationally representative survey should be used.
It is recognised that in some cases this may mean that the data reported in this round will be the same as the data reported in 2005, since such surveys are generally undertaken at three to five year intervals.
Ensuring the representativeness of samples taken for surveys of most-at-risk populations is a technical challenge. Methods are being developed to try to achieve representative sampling of these populations (i.e. respondent driven sampling). While these are being refined, it is recognised that countries may not be able to attest to the representativeness of samples used for surveys of most-at-risk populations. As such, countries are advised to report data for these indicators using the most recent survey of most-at-risk populations which has been reviewed and endorsed by technical experts within the country, such as by the M&E technical working groups or national research councils 62

63. STEPS FOR IN-COUNTRY UNGASS REPORTING PROCESS
Preparation
Monitor against action plan
Submission
Planning
This slide shows an example of the process for UNGASS reporting including preparation, planning, implementation and submission.
Each of these steps will be discussed in more detail.
Implementation 63

64. ROLES & RESPONSIBILITIES
The overall responsibility of preparing and submitting the Country Progress Report lies with national governments (NAC or equivalent)
UNGASS should be routine and integrated in the country’s M&E plans, budgets and systems

65. PREPARATION 1. Assess country readiness 2. Identify stakeholders
3. Identify funding
4. Identify relevant data tools / sources 65

66. ASSESS COUNTRY READINESS
Preparation
Countries are expected
to know their epidemic
to determine which of the UNGASS indicators are applicable to the country’s epidemiological context
to know availability of data
1 Countries are expected to "know their epidemic",
2 To review all of the indicators in the light of this knowledge to determine which ones are applicable in the country context
3 For each indicator that countries do not submit data for, countries are asked to indicate if (1) data are not available to answer that indicator, or (2) the indicator is not consider to be applicable to the epidemic situation in the country. 66

67. IDENTIFY STAKEHOLDERS
Preparation
Individuals and organizations who are affected by
HIV and/or are involved in the HIV response:
Government (including NAC, Ministry of Health, Ministry of Education; Ministry of Finance)
Civil society groups (including nongovernmental organizations, people living with HIV)
Private sector 67

68. IMPORTANCE OF CIVIL SOCIETY
Preparation
Strategic and tactical expertise
Quantitative and qualitative data
Valuable perspective on the data
Civil society plays a key role in the response to the AIDS epidemic in countries around the world. The wide range of strategic and tactical expertise within civil society organizations makes them ideal partners in the process of preparing National Progress Reports. Specifically, civil society organizations are well positioned to provide quantitative and qualitative information to augment the data collected by governments. They can provide a valuable perspective on the issues included in the National Composite Policy Index. They are also equally well positioned to participate in the review and vetting process for progress reports.

69. HOW AND WHEN TO INCLUDE CIVIL SOCIETY
Preparation
Involvement in all phases of the report preparation:
Identify relevant civil society organizations
Assign roles and responsibility
Plan with them data collection and analysis
Invite them to participate in workshops
Share drafts with them for review and comments
Disseminate final report to them 69

70. IDENTIFY SOURCE OF FUNDING
Preparation
What sources are available?
No separate funding available for UNGASS reporting, but should be integrated in M&E budgets (government, GFTAM, World bank)

71. DATA SOURCES Population-based surveys (e.g. DHS, AIS, MICS)
Preparation
Population-based surveys (e.g. DHS, AIS, MICS)
Special surveys (e.g. BSS, 2nd generation surveillance surveys, school surveys, health facility surveys)
Programme monitoring (e.g. patient tracking, Health Information System)
Key informants
Desk review
HIV surveillance / estimates 71

72. DATA CONSIDERATIONS Recency and representativeness of data
Preparation
DATA CONSIDERATIONS
Recency and representativeness of data
Requirements for disaggregation
Appropriate data process 72

73. PLANNING
Planning
Develop a plan for data collection / collation, analysis and report writing
Designate a coordinator
Assign roles and responsibilities for each indicator
Assign realistic timelines and milestones
Secure funding for the entire process (collecting, collating, analysing and reporting the data) 73

74. PLANNING (continued) Disseminate the plan
Use the plan as a checklist to monitor progress against the timeline and milestones 74

75. ACTION PLAN TEMPLATE Steps Activities Timeline Budget
Planning
ACTION PLAN TEMPLATE
Steps
Activities
Timeline
Budget
Responsible person
Stakeholders involved 75

76. IMPLEMENTATION
Implementation
Establish a process for data collecting / collating, vetting and analysis
Organise workshops for vetting and triangulation of data
Complete the appropriate data forms
Draft the Country Progress Report
Disseminate it for review and comment
Collate comments from stakeholders, including government agencies and civil society 76

77. IMPLEMENTATION (continued)
Organize a national consultation workshop to reach consensus with stakeholders on the final report
Enter agreed data into CRIS (or equivalent data management system)
Validate the indicator data against the report narrative (consistency check)
Finalize and submit the report to UNAIDS
Identify focal point for communication between UNAIDS Secretariat and country 77

78. MONITOR PROGRESS & DEBRIEF
Monitor progress throughout the implementation process using the action plan
Plan a debriefing meeting
to assess success of report (timeliness, comprehensiveness, quality)
to agree actions to undertake to strengthen the national M&E system 78

79. OVERVIEW OF THE REPORTING PROCESS
Identify data needs, data sources, stakeholders, funds
Establish plan for data collection, analysis and reporting writing
Secure funds, collect/collate and analyse data, complete data forms
Draft Country Progress Report, share draft with stakeholders
Enter data in CRIS
This figure shows an overview of the steps of the reporting process we have just gone through. Starting with identification of data, data sources, stakeholders and funding; before establishing an action plan for the process. Then the data collection, collating and analysis should be carried out after the funding is in place. The country progress report should be drafted using the data collected, and then shared with stakeholders for input and consensus. The next step is to enter the data into CRIS and the narrative report should be validate against the CRIS data. Before submission there should be consensus with the stakeholders about the data. It is important to stress that once the data have been submitted, they can not be changed so, it is important to make sure that the data are accurate. The last step is submission of the data and the narrative part of the Country Progress Report.
Validate the narrative report against the data in CRIS
Reach consensus with stakeholders on final Report & submit timely

80. FORMAT OF THE COUNTRY PROGRESS REPORT
Submission of report
Narrative part (see Appendix 2)
Structured to ensure consistent information across countries
Provide an in-depth analysis of data regarding the HIV epidemic and response
There are two parts of the Country Progress Reports that should be submitted to UNAIDS, namely a narrative part (including the NCPI as an annex) and the UNGASS indicator data. The narrative report should follow the suggested format that is provided in Appendix 2 in the Guidelines. The template for the country progress report has been made more structured for this round of reporting, to ensure consistency of information across countries. 80

81. UNGASS COUNTRY PROGRESS REPORT [Country Name]
Reporting period: January 2006–December 2007
Submission date: […]
Table of Contents
Status at a glance
Overview of the AIDS epidemic
National response to the AIDS epidemic
V. Best practices
VI. Major challenges and remedial actions
VII. Support from country’s development partners
VIII. Monitoring and evaluation environment
The template for the UNGASS country progress can be found in the guidelines as appendix 2. The sections of the report are:
II. Status at a glace: this section should provide a brief summary of
(a) the inclusiveness of the stakeholders in the report writing process;
(b) the status of the epidemic;
(c) the policy and programmatic response; and
(d) UNGASS indicator data in an overview table
III. This section should cover the detailed status of the HIV prevalence in the country during the period January 2006–December 2007 based on sentinel surveillance and specific studies (if any) for the UNGASS impact indicators. The source of information for all data provided should be included.
IV. This section should reflect the change made in national commitment and programme implementation broken down by prevention, care/treatment and support, knowledge and behaviour change, and impact alleviation during the period January 2006–December 2007.
Countries should be specifically address the linkages between the existing policy environment, implementation of HIV programmes, verifiable behaviour change and HIV prevalence as supported by the UNGASS indicator data. Where relevant, these data should also be presented and analysed by sex and age groups. Countries should also use the National Composite Policy Index (see Appendix 7). Countries are encouraged to report on additional data to support their analysis and interpretation of the UNGASS data.
V. This section should cover detailed examples of what is considered a best practice in-country in one or more of the key areas (such as political leadership; a supportive policy environment; scale-up of effective prevention programmes; scale-up of care, treatment and/or support programmes; monitoring and evaluation, capacity-building; infrastructure development. The purpose of this section is to share lessons learned with other countries.] 81

82. ANNEXES ANNEX 1 Consultation/preparation process for the Country
Submission of report
ANNEXES
ANNEX 1
Consultation/preparation process for the Country
Progress Report
ANNEX 2
National Composite Policy Index Questionnaire
There are two annexes to the country progress report and they should both be included in the narrative report when submitted:
Annex 1 is the consultation/preparation process for the Country Progress Report
Annex 2 is the National Composite Policy Index Questionnaire

83. COUNTRY PROGRESS REPORT Indicator Data
CRIS is the Country Response Inforamtion System

84. BENEFITS OF USING THE COUNTRY RESPONSE INFORMATION SYSTEM (CRIS)
Submission of report
BENEFITS OF USING THE COUNTRY RESPONSE INFORMATION SYSTEM (CRIS)
CRIS is a monitoring system which greatly
facilitates UNGASS reporting:
It supports all six UN languages [no need for translation]
It uses the current Guidelines [no confusion]
It uses the correct indicator definitions [no confusion]
It facilitates compilation and management of all UNGASS data [saves time]

85. BENEFITS OF USING CRIS (continued)
Submission of report
BENEFITS OF USING CRIS (continued)
It has built-in validity checks [avoids logical errors]
It stores available data from population-based surveys [saves time]
It facilitates trend analysis as previous UNGASS data is stored [saves time]
Data is seamlessly integrated into the global database [no transcription errors, no delays]

86. BENEFITS OF USING CRIS (continued)
Submission of report
BENEFITS OF USING CRIS (continued)
In addition to use for UNGASS reporting and
reporting to donors
CRIS can be used for the management of all
monitoring information at the national
and sub-national levels

87. SUBMISSION PROCESS What? Country Progress Report consisting of When?
Submission of report
What?
Country Progress Report consisting of
Narrative section (including Annex 1, Annex 2)
CRIS data file (or excel data file, see template on CD)
When?
15 January 2008 if not using CRIS
31 January 2008 if using CRIS [preferred]
How? to

88. WHAT HAPPENS AT UNAIDS/GENEVA?
UNAIDS and its partners are responsible for calculating the global indicators
A process for collating, analysing and reporting data in coordination with co-sponsors and global partners, including civil society occurs 88

89. WHAT HAPPENS AT UNAIDS/GENEVA?
Country Report Findings + Global indicators =
Report on the Global AIDS Epidemic
The country data together with the global indicators will then be used to produce the report on the Global AIDS epidemic. 89

90. WHAT HAPPENS AT UNAIDS/GENEVA?
The Report on the Global AIDS Epidemic is prepared by May 2008 and submitted to the United Nations General Assembly
The Country Progress Reports and the Global Report will be available on the UNAIDS website at 90

91. BENEFITS OF UNGASS REPORTING
Provides answers to important questions:
What is the status of the epidemic in the country?
What are the basic trends in HIV transmission and service coverage?
What are the main obstacles to accessing HIV prevention, care and treatment services?
What is the quality of services being delivered? 91

92. BENEFITS OF UNGASS REPORTING (continued)
Provides answers to important questions:
Are services being delivered equitably and effectively?
What exacerbates these problems? (e.g. policies, laws, resources, politics, customs, organizations, individuals)
Who can change this situation? (e.g. elected leaders, bureaucrats, religious leaders, community leaders, traditional leaders, donors, international organizations, NGOs)
What are these people/organizations currently doing to address the problems? 92

93. BENEFITS OF UNGASS REPORTING (continued)
This information can be used to
evaluate the effectiveness of the national response
analyse linkages between policy, implementation of programmes, behavioural change and HIV prevalence
identify gaps in programmes, personnel, technology
identify data gaps and data quality issues
strengthen the National M&E system 93

94. SUMMARY Ownership & participation Consultation & consensus
Data vetting, validation, triangulation
Timeliness: 31 January 2008
or 15 January 2008 if not submitted in CRIS
Focus on systems and process
To summarize what is important to the UNGASS reporting process:
- Ownership & participation throughout the whole process by both government and civil society
- Consultation & consensus during the entire process
- Data need to be vetted, validated, and triangulated before submission. After submission, the data can not be changed.
- Timeliness: 31 January 2008
(or 15 January 2008 if not submitted in CRIS)
- Focus on systems and process 94