OVERVIEW OF ARCHIVING OF MICRODATA SILAS M. MULWA Kenya National Bureau of Statistics United Nations Regional Seminar on Census Data Archiving for Africa.

Slides:



Advertisements
Similar presentations
Archiving Trevor Croft MICS3 Data Archiving, Dissemination and Further Analysis Workshop Geneva - November 6th, 2006.
Advertisements

Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving MICS4 Data Processing Workshop.
MICS4 Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Data Archiving.
DDI for the Uninitiated ACCOLEDS /DLI Training: December 2003 Ernie Boyko Statistics Canada Chuck Humphrey University of Alberta.
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
Enhancing Data Quality of Distributive Trade Statistics Workshop for African countries on the Implementation of International Recommendations for Distributive.
Fitting a survey life cycle in the DDI Irene Wong Chuck Humphrey IASSIST Edinburgh May 2005.
Access routes to 2001 UK Census Microdata: Issues and Solutions Jo Wathan SARs support Unit, CCSR University of Manchester, UK
Disseminating Statistical Products at CSA : Meeting User Needs
St. Lucia Country Report By Edwin St Catherine Director, Central Statistical Office Presented to IPUMS Workshop August 24 th, 2007.
United Nations Expert Group Meeting on Revising the Principles and Recommendations for Population and Housing Censuses New York, 29 October – 1 November.
Harnessing the Power of Microdata Standards, tools and best practices for microdata dissemination and management International Household Survey Network.
The International Household Survey Network IHSN IHSN Secretariat PARIS21 Steering Committee, 14 November 2007.
Using a Content Management System Website for the Dissemination of Official Statistics By Edwin St Catherine, Director of Statistics, SAINT LUCIA UN Regional.
STATISTICS CANADA SURVEY LIFECYCLE WOLFVILLE, APRIL 2008 SURVEY LIFECYCLE Michel B. Séguin Atlantic DLI Training.
POLICIES AND PROCEDURES FOR ARCHIVING DATA IN BURUNDI.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Country Practices on Census Data Archiving.
Multiple Indicator Cluster Surveys Data Dissemination and Further Analysis Workshop Data Archiving MICS4 Data Dissemination and Further Analysis Workshop.
MOLLA HUNEGNAW STATISTICIAN AFRICAN CENTRE FOR STATISTICS ECASTATS.UNECA.ORG Confidentiality and Anonymization of Microdata 1 United Nations Regional Seminar.
IPUMS to IHSN: Leveraging structured metadata for discovering multi-national census and survey data Wendy L. Thomas 4 th Conference of the European Survey.
World Bank, Africa Region, Africa Household Survey Databank - The World Bank - Africa.
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
Research data workflow Practice in Slovenian Social Science Data Archives SERSCIDA WP4 – WORKSHOP Ljubljana September 2013.
Changing the culture: Ethiopia’s commitment to dissemination and the multi-media approach By Yakob Mudesir Seid
DEMANDS FOR AND PROVISION OF CENSUS MICRO DATA: THE SRI LANKAN EXPERIENCE Vasana Jayakody Department of Census and Statistics Sri Lanka.
Use of Technological Tools in the Dissemination of Census Data Application to CARICOM Region.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
Data archive in developing countries: preservation and dissemination of microdata as an instrument for better development results Olivier Dupriez Senior.
IHSN International Household Survey Network Strategy for the Development of Data: Improve the Availability, Accessibility, and Quality of Survey Data Mahesh.
Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.
Population census micro data for research: the case of Slovenia Danilo Dolenc Statistical Office of the Republic of Slovenia Ljubljana, First Regional.
Innovations in Data Dissemination Thomas L. Mesenbourg, Jr. Acting Director U.S. Census Bureau United Nations Seminar on Innovations in Official Statistics.
Documenting and disseminating census and survey data sets Ilpo Survo, United Nations ESCAP, Bangkok, for UNECE.
International Initiatives International Household Survey Network and Accelerated Data Program Olivier Dupriez World Bank / IHSN.
IMPLEMENTATION OF DDI STANDARD IN THE STATISTICAL AGENCY UNDER PRESIDENT OF THE REPUBLIC OF TAJIKISTAN.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Documentation and Cataloguing in Data.
National design, fieldwork and data harmonization for Labour Force Survey Irena Svetin Statistical Office of the Republic of Slovenia September 2014.
Presenter: Silas Mulwah Organization:Kenya National Bureau of Statistics  th September 2013, United Nations Regional workshop on Data Dissemination.
United Nations Economic Commission for Europe Statistical Division Mapping Data Production Processes to the GSBPM Steven Vale UNECE
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
ADP SUPPORT IN UGANDA BUILDING A NATIONAL DATA ARCHIVE Presented by Kizito Kasozi Director Information Technology Uganda Bureau of Statistics PARIS21.
Secure Epidemiology Research Platform (SERPent) Kick Start Meeting - April 15 th, 2010 Pascal Heus
United Nations Statistics Division Work Programme on Economic Census Vladimir Markhonko, Chief Trade Statistics Branch, UNSD Youlia Antonova, Senior Statistician,
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Developing and applying business process models in practice Statistics Norway Jenny Linnerud and Anne Gro Hustoft.
Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.
United Nations Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September, 2011 Introduction to Census Archiving Session.
Assessment and Prioritisation of user needs: Challenges Workshop on Review of the Implementation of the Reference Regional Strategy Framework for Statistical.
Archiving microdata Standards and good practices United Nations Statistics Commission New York, February 26, 2009 Olivier Dupriez World Bank, Development.
National Boot camp Vancouver Heather Dryburgh and Michel B. Séguin May 31 st, 2011 Survey Life cycle.
Statistical Metadata Extensions to the X3.285 Metamodel By Daniel W. Gillman Chairman, NCITS/L8 U.S. Bureau of the Census.
5.8 Finalise data files 5.6 Calculate weights Price index for legal services Quality Management / Metadata Management Specify Needs Design Build CollectProcessAnalyse.
UNSD/ NSCB Regional workshop on data dissemination & communication Manila, Philippines, June 2012 Promoting (survey) microdata dissemination policies:
Presented By Margaret Hellen Atiro Uganda Bureau of Statistics at the United Nations Regional Seminar on Census Data Archiving 20 – 23 Sep 2011, Addis.
Role of Metadata in dissemination of census data Regional Seminar on dissemination and spatial analysis of census data, Nairobi, September, 2010.
30TH May 2017 Dar-es-Salaam, Tanzania
Setting Up a National Data Archive: The Ugandan Experience
International Household Survey Network
Olivier Dupriez World Bank / IHSN
Access Policy and Dissemination of Microdata By Didier UYIZEYE
5 November, 2018 Nuku’alofa, Tonga
BETTER AND PROPER ACCESS TO PACIFIC MICRODATA
Noumea, New Caledonia, 3 to 7 December, 2018
The Role of the World Bank in Supporting Statistical Capacity in Africa Graham Eele.
Liberia Institute of Statistics and Geo-Information Services (LISGIS)
The role of metadata in census data dissemination
The Role of Metadata in Census Data Dissemination
The Role of Metadata in Census Data Dissemination
Presentation transcript:

OVERVIEW OF ARCHIVING OF MICRODATA SILAS M. MULWA Kenya National Bureau of Statistics United Nations Regional Seminar on Census Data Archiving for Africa Addis Ababa, rd September 2011

OUTLINE  Definition of Micro-data  Why disseminate Micro-data?  Acquisition and preparation of data  Tools for Archiving of Micro-data  Dissemination of micro-data  Risks of disseminating microdata

Definition of Micro-data Micro-data: are defined as files of records pertaining to individual respondent units (mainly through household interviews). Micro-data files for dissemination purposes may differ from those used within the KNBS;  all direct and indirect identifiers have may be removed through various anonymization processes  Micro-data as opposed to Macro-data contains records pertaining to individual firms/institutions or aggregated records at national or county levels.

Why disseminate Data use?  To Broaden data use and reuse  To add value to data bringing subject matter knowledge to data analysis  To get feedback from the data users, which could be used to improve data quality and also improve data collection in the future.

5  Foster diversity and deepen the quality of data analysis thereby extracting more information from the data.  Reduce duplication in data collection  Leveraging funding for statistics  Complying with a contractual or legal obligation e.t.c. Why disseminate Data use? Cont’

Acquisition and preparation  Questionnaire Design and Sampling design  Data collection  Data is coded after collection  Data Capture  Draft Data is archived using tools  Data editing and derived variables created  Edited set is archived followed by anonymization

Tools for Archiving of Micro-data 1.Data archiving has various components these includes;  Data documentation  Cataloguing  Data dissemination  Anonymization  Preservation. A combination of tools are required so as to construct all the components.

Archiving tools cont’d KNBS has used both standard and non standard tools for data archiving.  IHSN micro-data management Toolkit – It is a standard kit for documenting datasets in compliance with Data Documentation Initiative (DDI) and the Dublin Core Standards.  KNBS has not used the toolkit to document census micro-data but 7 survey datasets have been documented and archived using this tool.

Archiving tools cont’d  NADA Is DDI standard compliant for archiving and dissemination. KNBS has not used the tool but it is building capacity on NADA  Redatam – IMIS (integrated mult-sectoral information system) KNBS has used IMIS to store 1989, 1999 Census Microdata. Mainly it is used to query information and is web-based

Archiving tools cont’d CSPRO and ICADE:  Not for archiving but for capturing and storage of census-data Micro-data, there is very little documentation apart from providing ASCII file structures

DISEMINATION OF MICRO-DATA  Due to Technological advancement in ICT and increased demand for data, KNBS is changing the way of accessing and disseminating information to the users.  Traditionally KNBS has been using publications, seminars and workshops to release and disseminate survey and census data.  Census micro-data can be accessed and queried using IMIS.

DISEMINATION OF MICRO-DATA cont’d  Offline Dissemination CDs, DVDs are used for data distribution Microdata after anonymisation process. Only 5% of Census data can be given to users on special request.  Mobile Dissemination: It was used to disseminate 2009 population census results.

Risks of disseminating microdata Disclosure:  This is the risk of re-identification of particular individuals and is one of biggest challenges.  It can lead to violation of laws, lose of trust by the public and compromise quality Controversy of results: User may obtain different results from the one published by KNBS resulting to controversy and criticism

END OF PRESENTATION