Data Reconciliation Issues Neda Jafar Workshop on MDG Data Reconciliation: Employment Indicators July, Beirut Workshop on MDG Data Reconciliation: Employment Indicators July, Beirut

“Not everything that can be counted counts; and not everything that counts can be counted.” —ALBERT EINSTEIN

International Mandates In July 2006, the Economic and Social Council adopted its resolution 2006/6 on strengthening statistical capacity in countries and included a set of recommendations to improve the coverage, transparency and reporting on all indicators ESCWA resolution 287 (XXV) on Strengthening statistical capacities for evidence-based policymaking which “Encourages member countries to produce MDG indicators, and requests the secretariat to assist member countries in building their capacity to unify concepts and definitions”.

297 (XXVI). Arab MDG monitor for societal progress 1. Calls upon all member countries to enhance coordination between national statistical offices and implement national strategies for statistical development, with a view to improving the coverage and transparency of indicators and methods of reporting on them and disseminating effective methods of monitoring nationally and internationally agreed development goals, including MDGs, by: (a) Defining priorities and developing a strategy to provide data for all indicators; (b) Identifying ways, including through capacity-building to improve monitoring and reporting on development indicators, including indicators relating to MDGs; (c) Ensuring that the supporting metadata comply with standard guidelines; 2. Requests the secretariat to assess the quality of national data and development indicators, including MDGs, and providing adequate resources to improve data quality and convergence with international standards

Findings: Major differences exist in the data availability reported by the two sources. The greater the difference in data availability reported, the higher the possibility of major shortcomings in the reporting mechanism between them UNSD therefore disseminates little more than half the data reported in national third of the national data are not reported in UNSD db National disaggregated data available and are not reported in UNSD database

Discrepancy in data value emanates from one or more components related to metadata : – definition – classifications – method of calculation – targeted population and subpopulation – proxy indicators – sources of data – data series – extrapolation/estimation methods

Objectives Build national capacities Improve data quality Ensure transparency Reduce data gaps and increase availability Reduce inconsistency Increase production Enhance dissemination

Reconciling international and national sources for effective global monitoring 1.Global monitoring - IAEG Compilation of international sources Improving international sources and resolving data gaps and discrepancies 2.Regional monitoring - ESCWA Compilation of national data Improving national sources and resolving data gaps and discrepancies with international sources

Data compilation: from national sources to the MDG database International agency country office Agency Headquarters eg. UNICEF Line Ministry in the country National Statistical Office in the country Agency Headquarters eg. UNESCO Agency Headquarters eg. ILO MDG Indicators database 60 MDG indicators + background/additional indicators 192 Member States

Data provided by the international agencies

DATA: national, modeled or estimated Source: MDG Indicators Database, at mdgs.un.org Indicator Countries with at least 1 data point Countries with at least 2 data points Number% % Population below $1 (PPP) per day Children under 5 moderately or severely underweight Total net enrolment ratio in primary education Literacy rates Share of women in wage employment in non-agricultural sector Children under five mortality rate per 1,000 live births Maternal mortality ratio per 100,000 live births HIV prevalence among population years old Condom use at last high-risk sex, women Contraceptive use Tuberculosis death rate per 100,000 population Proportion of the population using improved sanitation Slum population Country dataEstimatedModelled

Different types of data in international data sources

MDG metadata compilation Development and enhancement of metadata for the global monitoring - Custodian agencies provide metadata and updates as necessary - Indicator metadata is stored in a repository -Footnotes are accessible together with the data -Exchanges usually via

Improve transparency in the MDG Indicators Database Metadata for MDG Indicators in MDG Database CONTACT POINT in international agency DEFINITION METHODS OF COMPUTATION COMMENTS AND LIMITATIONS SOURCES OF DISCREPANCIES BETWEEN GLOBAL AND NATIONAL FIGURES PROCESS OF OBTAINING DATA TREATMENT OF MISSING VALUES DATA AVAILABILITY REGIONAL AND GLOBAL ESTIMATES EXPECTED TIME OF RELEASE

Regional Priorities Improve data quality and transparency of methods Identify good practices for coordination within national statistical systems Identify good practices in reporting mechanisms to the international statistical system Address key methodological issues, including the use of population figures, in the computation of the indicators Develop improved training tools on the compilation of the indicators Improve consistency and transparency in reporting and presenting data and metadata for the international monitoring (DevInfo and SDMX trainings) Provide technical assistance to countries in the use of international definitions. Improve the process of consultation by international agencies with countries before publishing their data

9 th SC PROPOSALS FOR national level: (i) Data availability can be improved in the following ways: 1.Review current methodologies for imputations and consultation mechanisms with national statistical offices; 2.Organize workshops and/or producing handbooks and guidelines to improve the production and transparency of indicators and methodologies 3.Provide direction on recommended consultation mechanisms, with a view to bringing the least-tracked indicators, in particular, into line with international standards; 3.Carry out the required surveys and censuses, and improving administrative registers for the periodic production of data on MDG indicators, other development data and country-specific indicators; 4.Develop and maintain a central repository at the national and subnational levels that is disaggregated by sex, where applicable, and user-accessible;

(ii) Dissemination can be improved in the following ways: 1.Publish metadata with relevant indicators in order to improve transparency, quality and dissemination practices in line with international standards; 2.Provide disaggregated data, where applicable, by age, educational attainment, geographical area, ethnic group, urban/rural and gender in order to highlight patterns within countries, thereby facilitating comparisons across subpopulations for effective planning and budgeting by policymakers; 3.Publish a new round of MDG reports, taking note of the new MDG indicators and incorporating comprehensive coverage in terms of disaggregated data with relevant metadata and trend analysis to track progress towards the achievement of MDGs;

@ regional level: 1.Review and identify regional priorities and propose ways of improving the production and analysis of MDGs, including development indicators; 2.Propose future courses of action, particularly in terms of recommending areas and modalities for technical cooperation and statistical capacity-building; 3.Develop and maintain a regional central database derived from national databases and publications aimed at monitoring availability, tracking progress and planning capacity-building activities in focused statistical areas; 4.Review and discuss data gathering mechanisms available to international agencies, their methods of compilation of international data series, and the imputation techniques used to calculate regional and global estimates for MDG indicators;

@ regional level: Identify ways of improving compilation of regional data series by improving reporting mechanisms from national statistical systems to international agencies; Compile and review national metadata published in national central databases and make recommendations on ways of improving them; Review current methodologies for imputations and consultation mechanisms with member countries and recommend methods to improve methodologies, transparency and consultation mechanisms, both within countries and with international agencies.