WHO/UNICEF Joint Monitoring Programme for Water Supply and Sanitation (JMP) Comparing national and international monitoring of the MDG drinking water and sanitation target Rolf Luyendijk,UNICEF UNSD/UN-ESCAP Workshop Bangkok, Thailand, January, 2009

1.Introduction 2.Data sources 3.JMP Methodology 4.Definitions 5.Comparing national and international monitoring This presentation

WHO/UNICEF Joint Monitoring Program (JMP)  Established in 1990  Secretariat: World Health Organization & UNICEF World Health Organization & UNICEF

WHO-UNICEF Joint Monitoring Program (JMP)  Responsible for monitoring progress towards MDG 7 Target 7c Global accountability and advocacy Global accountability and advocacy  Biennial updates of coverage estimates Water supply & sanitation Water supply & sanitation urban, rural, and totalurban, rural, and total by country, region and at global levelby country, region and at global level

Sanitation in Asia: Urban and rural disparities 2006 WHO/UNICEF JMP, 2008 Urban Rural Improved sanitation coverage, 2006 Less than 50% 51% - 75% 76% - 90% 91% - 100% No or insufficient data

1.Introduction 2.Data sources 3.JMP Methodology 4.Definitions 5.Comparing national and international monitoring

Data sources on access to drinking water and sanitation  1980 – 1997 Reported data from Governments  1997 – data from household surveys and censuses  JMP data sources are primary sources: National household sample surveys (DHS, MICS, LSMS, CWIQ, WHS, HBS, H&N, RHS, PAPFAM etc) National household sample surveys (DHS, MICS, LSMS, CWIQ, WHS, HBS, H&N, RHS, PAPFAM etc) National censuses National censuses  Note: JMP is not involved in primary data collection

How does the JMP obtain national census and household survey data?  DHS surveys - directly from MACRO-International  MICS surveys from UNICEF  WHS surveys from WHO Other surveys and census data:  UNICEF country offices - annual data compilation  International Household Survey Network  Internet searches of NSO websites Question: What would be an appropriate mechanism for NSOs to submit new survey and census data on water and sanitation to the WHO/UNICEF JMP?

Use of “user-based” data vs. “provider-based” data  Standardized definitions among surveys  Objective “snapshot” of the situation Nett picture of new facilities constructed and those fallen in disrepair Nett picture of new facilities constructed and those fallen in disrepair Avoid double counting of upgraded improved facilities (e.g. hand pump to piped house connection) Avoid double counting of upgraded improved facilities (e.g. hand pump to piped house connection)  Allows for analyses Disaggregated into wealth quintiles Disaggregated into wealth quintiles Comparable across countries Comparable across countries Monitor trends over time Monitor trends over time

Reported data Survey data Coverage distribution

JMP – data base (2008)  Data for +/- 170 countries  600+ results of HH surveys + Censuses from 1985 – 2006  Bulk of surveys for LDCs, SSA, larger developing countries  new survey results per year  Frequency for most developing countries one survey every three years

1.Introduction 2.Data sources 3.JMP Methodology 4.Definitions 5.Comparing national and international monitoring

Monitoring MDG drinking water and sanitation targets  A country’s responsibility  At global level: JMP  Challenges:  Track progress over time  Ensure comparability over time  Track progress towards the MDG target vs. baseline year 1990 baseline year 1990  Ensure comparability of data among countries ( JMP specific challenge ) countries ( JMP specific challenge )

Latest data point DHS 2002 :51% Hallo

Estimates Coverage 2004 = 50% Latest data point DHS 2002 :51% Hallo

Estimates Coverage 2004 = 50% = 54% 2006 = 57% Added Fictive data point 2005 :58% Hallo

Estimated Coverage 2004 = 50% = 54%= 54% 2006 = 57% = 59% 2008 = 63% Added Fictive data point 2008 :65% Hallo

Estimated Coverage 2004 estimate = 50% Latest data point DHS 2002 :51%

2004 = 50% = 54% 2006 = 57% Added Fictive data point 2005 :58%Estimated Coverage 2004 = 50% = 49% 2006 = 52% Added Fictive data point 2005 :49% Hallo

JMP Methodology - Summary   Primarily based on user data derived from household surveys and censuses rather than data reported by governments   Adjustments made to full historical series to ensure comparability over time and between countries   Use linear regression to extrapolate and interpolate reference years instead of using the latest household survey data

1.Introduction 2.Data sources 3.JMP Methodology 4.Definitions 5.Comparing national and international monitoring

Core question on water and sanitation for household surveys - What is measured?  What is the main source of drinking water for members of your household?  What kind of toilet facility do members of your household usually use?  uestions.pdf uestions.pdf uestions.pdf Standard set of only eight questions used by DHS and MICS Standard set of only eight questions used by DHS and MICS Detailed descriptions and definitions of technologies Detailed descriptions and definitions of technologies Indicator tabulation plans Indicator tabulation plans

MDG target + Indicators MDG 7 Target 10:  Halve, by 2015, the proportion of people without sustainable access to safe drinking water and basic sanitation Indicators (based on information collected) :  Proportion of population that uses an improved drinking water source, urban and rural  Proportion of population that uses an improved sanitation facility, urban and rural

“Improved” means…. An improved drinking water source is: “a source that by nature of its construction is adequately protected from outside contamination in particular with fecal matter” An improved sanitation facility: “ a facility that hygienically separates human waste from human contact”

JMP definitions of improved/unimproved  Piped into dwelling, plot or yard  Public tap/standpipe  Tube well/borehole  Protected dug well  Protected spring  Rainwater collection  Flush/pour flush to:  piped sewer system  septic tank  pit latrine  Ventilated improved pit (VIP) latrine  Pit latrine with slab  Composting toilet  Unprotected dug well  Unprotected spring  Cart with small tank/drum  Tanker truck  Surface water (river, dam, lake, pond, stream, canal, irrigation canal)‏  Bottled water  Flush/Pour flush to elsewhere  Pit latrine without slab/open pit  Bucket  Hanging toilet/hanging latrine  Shared sanitation of any type  No facilities, bush or field UN-IMPROVED IMPROVED Drinking WaterSanitation

What HH Surveys tell us:  Disaggregation by: - Facility types / access levels (e.g. piped connections into dwelling, borehole with hand pump, open defecation, pour flush latrines, etc) - Urban and Rural areas - Time to source (go to, get water and come back) - Wealth quintiles (access of the 20% poorest and 20% richest) - Sometimes disaggregation possible by region or province

1.Introduction 2.Data sources 3.JMP Methodology 4.Definitions 5.Comparing national and international monitoring

Most common discrepancies between national and international coverage estimates (in order of most frequent occurrence) 1.Use of different definitions of access or poorly defined categories Indonesia: ‘Pit’ or ‘Hole’ is acceptable (?) Indonesia: ‘Pit’ or ‘Hole’ is acceptable (?) MDG definition: shared sanitation facilities are ‘unimproved’ MDG definition: shared sanitation facilities are ‘unimproved’ 2.Use of latest survey or census data instead of a computed estimate 3.Use of different population estimates 4.Use of old estimates, instead of latest available data 5.Use of reported (provider-based) data rather than household survey or census data

Often there are discrepancies within a country or between surveys about what constitutes coverage….  Use of different definitions by different national authorities China National Health Systems Survey : ‘Harmless sanitary latrines’ China National Health Systems Survey : ‘Harmless sanitary latrines’ China Ministry of Health: ‘Sanitary latrines’ China Ministry of Health: ‘Sanitary latrines’  Use of different response categories among different surveys describing the same facility Tanzania, Kazakhstan, etc. traditional pit latrine, latrine, pit latrine, pit, pit latrine with slab Tanzania, Kazakhstan, etc. traditional pit latrine, latrine, pit latrine, pit, pit latrine with slab  Poor or incomplete disaggregation of response categories Drinking water category: Indonesia: ‘Piped’ Drinking water category: Indonesia: ‘Piped’ No listing of unimproved categories e.g. open defecation No listing of unimproved categories e.g. open defecation  Substitute of responses Thailand, Indonesia, Philippines: ‘bottled water’ for piped water supply into dwelling Thailand, Indonesia, Philippines: ‘bottled water’ for piped water supply into dwelling

Adjustments made to survey or census data set (1) Example:  HBS ‘86: Latrine: 58%Improved  DHS ‘89: Pit: 62% Improved ?  Census ‘92: Open pit: 59%Not improved  MICS ‘95: Traditional latrine: 60%Improved?  How to interpret these categories? Adjustment: half of the facilities are considered improved  Suggested re-classification: Pit latrine with a slab Pit latrine with a slab Pit latrine without a slab/open pit Pit latrine without a slab/open pit

Adjustments made to survey or census data set (2) Example:  DHS ‘98: Well: 22%Improved?  Census ‘00: Protected dug well: 14%Improved  Census ’00: Unprotected dug well: 6% Not Improved Did coverage drop by = 8% over the period ?  Adjustment: Improved dug well DHS ’98: 14/(14+6) x 22% = 15.4%

Why is a good disaggregation of response categories so important? Open defecation Not improved Shared Improved South Asia Eastern Asia & Pacific Tracking of progress Advocacy Accountability Programming Learning Sanitation

Example Uganda: Monitoring for Learning Trend of population with and without access to an improved drinking water source Source: Special tabulation, 2007 Use of an unimproved drinking water source 1990: 61% = 9.7 million people 2006: 40% = 10.3 million people Urban and rural disparities The majority of the population without access to safe drinking water lives in rural areas

Example Philippines: Monitoring for Programming Trend of population with and without access to sanitation Source: Special tabulation, 2007

Source: Indonesia DHS 2003 special tabulation Uganda DHS 2005 special tabulation Example: Monitoring for Advocacy Wealth quintile analysis: The richest 20% are more than five times as likely to use an improved sanitation facility as the poorest 20%

Source: Special tabulation, 2007 Example Viet Nam: Monitoring for Accountability Progress towards the MDG drinking water and sanitation target

JMP Website:  JMP country files Four graphs with regressions line Four graphs with regressions line All HHS + census data per country All HHS + census data per country  Regional and global coverage estimates  Core questions on WSS for household surveys incl: Standard indicators Standard indicators Definitions of service categories Definitions of service categories

Thank You!

JMP Challenges ahead (1) Global and National  2007 – 2010: regional and country workshops, comparing UN - with national coverage estimates and MDG monitoring to exchange experiences for mutual learning and understanding  Facilitate the development and roll-out of standard protocols for water quality monitoring

Challenges ahead (2) Methodological Challenges  Continue to develop and validate tools and instruments to measure: Sustainable access Sustainable access Safe drinking water – water quality Safe drinking water – water quality Access to basic sanitation Access to basic sanitation Appropriate hygiene - and hand washing behaviour Appropriate hygiene - and hand washing behaviour Disparities (pro-poor focus) Disparities (pro-poor focus) Access in peri-urban and urban slum areas Access in peri-urban and urban slum areas Disaggregate urban data between cities and small towns Disaggregate urban data between cities and small towns Challenges for wider sector monitoring  Strengthen sub-national monitoring  Invest in sector monitoring of the enabling environment E.g. policies, HR capacity, financing mechanisms and investments, sustainable operation & maintenance, decentralization of authority, quality management etc. E.g. policies, HR capacity, financing mechanisms and investments, sustainable operation & maintenance, decentralization of authority, quality management etc.

Monitoring challenges at national level  Regularly collect, use, analyze and disseminate existing and new monitoring data and information for ACTION: Advocacy Advocacy Programming Programming Accountability Accountability Learning Learning To accelerate progress towards the MDGs To accelerate progress towards the MDGs  Use standard definitions of access and consistently monitor those over time  Set “own” MDG drinking water and sanitation target