Harnessing the Power of Microdata Standards, tools and best practices for microdata dissemination and management International Household Survey Network (IHSN)

Data Life Cycle Evaluate Archive Disseminate Analyze Process Collect Build Design Specify needs International Household Survey Network (IHSN) Metadata management (documentation) Policymaking Research Statistical Integration

Why disseminate microdata? Support research and policymaking. Tabular and aggregated outputs will not meet all specific needs of researchers. Microdata dissemination meets specialised needs of researchers and students, and encourages diversity of analysis. Increase returns on data collection. Microdata dissemination reduces the risk of duplicated activities and the burden on respondents. Improve quality and credibility of data and output. Broader access to metadata and microdata makes replication (or correction) of analysis possible. Improve future data collection. Through wider use of microdata, NSO also gains insights for improvement for future data production. Promote development of new data models and analytics. International Household Survey Network (IHSN)

Costs and risks Confidentiality. One of the biggest challenges of microdata dissemination is to minimize the risk of disclosure of any data that would compromise the identity of respondents Official vs. non-official results and contradiction. Dissemination of microdata may lead to a proliferation of differing -and possibly contradictory- results and statistics. Legal concerns. Countries’ specific statistical legislation. Financial cost. Cost of creating microdata files, access tools and safeguards, and of supporting enquiries International Household Survey Network (IHSN)

Safe Dissemination An enabling legislation – Provision in statistics’ acts enabling release of microdata files A microdata access policy specifying conditions – Public Use Files. Open to anyone with access to an NSO website – Licensed Files. User(s) have to be identified and agree to the terms and conditions. Access requests are reviewed and approved by NSO. – Data enclaves. Access limited on NSO premises, supervised by NSO staff. Results screened before taken outside. International Household Survey Network (IHSN)

Application for access to a licensed file Example from Rwanda-NADA

Why are metadata important for microdata dissemination? Metadata is “data about data”, e.g. study description, sampling, codebook, questionnaires, etc. For data producers, well-documented metadata – increase the credibility and transparency of statistical outputs – preserve institutional memory – allow replication of data collection and analysis For data users, well-documented metadata help – better understand why, when, how and by whom microdata were produced – make better use of microdata, avoiding misuse and or misinterpretation International Household Survey Network (IHSN)

Why are metadata important? Different variable definitions can mean different estimates for indicators. Well- documented metadata are crucial for data harmonization. In this example, metadata helped understand and reconcile the differences in the estimates of “access to safe water” International Household Survey Network (IHSN) SurveyDefinition of safe water OriginalNew DHS 1999 Assumes that water from pipes, private wells, boreholes, and springs are not contaminated. 53.1%53.0% CLFS2000 Safe is not defined. Unsafe sources are defined as ponds, stream or river and rainwater. 69.3%50.8% DHS 2003 Sources of water expected to be relatively free of disease are piped water and water drawn from protected wells and deep boreholes. 42.0%42.7% NLSS 2004 Pipe water, untreated pipe, borehole and protected well are considered safe 60.0%60.7% CWIQ 2006 Safe water source is defined for households using treated piped water, bore hole/hand pump or protected well. 51.4%53.4% GHS 2006 Safe water is constituted by those who use: piped treated water, piped untreated water, borehole with hand pump and well/spring protected water. 46.4%49.1% MICS 2007 Piped into dwelling, Piped into yard or plot, Public tap/standpipe, Tubewell/borehole, Protected well, Protected spring, Rainwater collection, Bottled Water are considered safe 49.1%50.4% BASE 2008 Safe water includes: Household Connections, Boreholes with hand pump, Motorized borehole, Protected Dug well, Public Standpipe, Rain water harvesting, Protected Spring … 53.3%

When to document metadata? Evaluate Archive Disseminate Analyze Process Collect Build Design Specify needs Documentation should be an ongoing process, to ensure quality and completeness, prevent information loss and reduce cost International Household Survey Network (IHSN) Metadata management (documentation)

Tools: National Data Archive (NADA) 4.0 Allows data producers to document and disseminate microdata and metadata in a secured environment, in compliance with their own policies and processes Used internally and/or externally Available in Arabic, English, French, Portuguese, Russian and Spanish International Household Survey Network (IHSN)

100+ agencies in 65+ countries in the world (27 countries in Africa) have established an online catalog using NADA International Household Survey Network (IHSN)

Engaging Users Promote the use of existing microdata, tools and policies Identify who the users are Understand what user demands are: consult users on data availability, accessibility and relevance  a feedback loop leading to better data and better use of data International Household Survey Network (IHSN)

About IHSN A network of over twenty international agencies, launched as a recommendation of the Marrakech Action Plan for Statistics (MAPS) 2004 develop tools and guideline on microdata documentation, preservation, anonymization, cataloguing and dissemination; assess and improve survey methods Accelerated Data Program (ADP) uses IHSN tools and guidelines to help data producers in developing countries increase the use and value of microdata International Household Survey Network (IHSN)

Thank you! For more information, visit: International Household Survey Network (IHSN)