MICS4 Survey Design Workshop Data archiving refers to the long-term storage of data and documentation Survey and census microdata are valuable resources for government departments and academic researchers They constitute valuable and irreplaceable assets which should be managed in a way that encourages their widest possible use and re- use. Data archiving
MICS4 Survey Design Workshop Why archive data? Collecting data is expensive Data can and should be used beyond producing basic report Examples: examine trends –Able to examine trends if you have a series of datasets over time in-depth analysis –Allows in-depth analysis of important subject areas
MICS4 Survey Design Workshop Difficult to find any information without documentation Difficult to perform analyses and to interpret findings Data are useless without documentation Allows reuse of documents for future surveys Why document data?
MICS4 Survey Design Workshop What do users expect? Well documented data Comprehensive Clear, consistent, easy to use data Information to be able to –Fully understand the survey, especially Sample design, selection and weighting Field procedures Data processing Datasets –Accurately analyze and use data
MICS4 Survey Design Workshop What What to save? Datasets: –Household –Household listing –Women –Children –… –Birth history –Mosquito nets
MICS4 Survey Design Workshop What What to save? Questionnaires Interviewers & other field manuals Sampling information Sample selection & listing information Reports Other documentation…
MICS4 Survey Design Workshop What What to save? Programmes –Data entry & menu systems –Secondary editing & menu systems –Export & recoding –Tabulation programs –Other data processing files
MICS4 Survey Design Workshop What to save? DevInfo databases Wallcharts Factsheets Press releases And lots more!!
MICS4 Survey Design Workshop When When to archive? Archiving is often seen as the last step in data collection activities As a result, documentation is often of uneven or poor quality Start archiving when you start the survey and prepare electronic copies of all the documents you produce
MICS4 Survey Design Workshop How How to archive datasets? Save datasets –in original format (e.g. CSPro files) –in analysis file format (e.g. SPSS *.sav file) Always include descriptions with data –Label all data within each file Variable labels Value labels
MICS4 Survey Design Workshop How How to archive documents? Save as much as possible electronically –Paper documentation disappears –Electronic documentation has a longer life Save documents –in original format –in HTML –as PDF files Record information not already in key documents Use an archiving tool –International Household Survey Network Microdata Management Toolkit
MICS4 Survey Design Workshop Microdata Management Toolkit Tools to facilitate archive and dissemination of surveys International Household Survey Network [IHSN] Established in September 2004 International organizations actively sponsoring household surveys + NSOs Coordination: ILO, DFID, Paris 21, UNICEF, UNSD, WHO, World Bank
MICS4 Survey Design Workshop Toolkit Components Metadata EditorArchiving: Metadata Editor (World Bank / Nesstar Ltd.) –Compile survey data, documentation and metadata in a standard format (Nesstar/DDI). Free data reader for users. –Built on Nesstar Publisher CD BuilderDissemination: CD Builder (World Bank / Mark Diggory) –Facilitate the publication of survey data, documentation and metadata on CD- ROM and on the web (transforms DDI into HTML based navigation) –Based on Eclipse Platform, open source Nesstar Explorer –Free software –Access metadata & data and export to common statistical formats IHSN Tools –Reporting, diagnostics and other utilities
MICS4 Survey Design Workshop What is the Metadata Editor? Template driven specialized editor Import/Export common data files Integrated interface, multilingual support Metadata and data in single file
MICS4 Survey Design Workshop What is the Metadata Editor?
MICS4 Survey Design Workshop CD Builder What is the CD Builder? Publishes survey metadata, documents and data on a CD-Rom or web site Transforms archive into an HTML based interface User can customize the layout (branding) and content of the CD (single or multi-surveys) Integrates with Metadata Editor
MICS4 Survey Design Workshop Data archiving – one place source for all data Download material
MICS4 Survey Design Workshop Process and availability 2 nd MICS4 Workshop - Introduction on how to archive data using Microdata Management Toolkit A license for Metadata Editor Support from NSO focal points for Toolkit (identified by IHSN in countries where the Toolkit is used) Technical support provided by HQ MICS team