Theme (ii): New Data Sources and Census

Slides:



Advertisements
Similar presentations
Paul Smith Office for National Statistics
Advertisements

1 Editing the Integrated Census in Israel. EDITING THE INTEGRATED CENSUS IN ISRAEL Prepared by Eva Rotenberg, Central Bureau of Statistics, Israel (1)
Discussion of topic VI Censuses Work Session on Data Editing Vienna, April 21 st -23 rd 2008 Heather Wagstaff & Thomas Burg.
Some considerations on developing a DWH for SBS estimates Orietta Luzi – Mauro Masselli Istat - Italy march 2013.
Migration of a large survey onto a micro-economic platform Val Cox April 2014.
CountrySTAT Team-I November 2014, ECO Secretariat,Teheran.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
1 Editing Administrative Data and Combined Data Sources Introduction.
E&I for 2006 Canadian Census Mike Bankier Statistics Canada
Eurostat Statistical Data Editing and Imputation.
The Future of Administrative Data ICES III End Panel Discussion Don Royce Statistics Canada June 2007.
New and Emerging Methods Maria Garcia and Ton de Waal UN/ECE Work Session on Statistical Data Editing, May 2005, Ottawa.
Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,
Metadata driven application for data processing – from local toward global solution Rudi Seljak Statistical Office of the Republic of Slovenia.
Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
Lyne Guertin Census Data Processing and Estimation Section Social Survey Methods Division Methodology Branch, Statistics Canada UNECE April 28-30, 2014.
Paolo Valente - UNECE Statistical Division Slide 1 Technology for census data coding, editing and imputation Paolo Valente (UNECE) UNECE Workshop on Census.
Copyright 2010, The World Bank Group. All Rights Reserved. Managing Data Processing Section B.
Heather Wagstaff and Thomas Burg Topic (vi) Methodologies for Editing Census Data INTRODUCTION UNECE Work Session on Statistical Data Editing:Vienna
Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.
Towards the 2011 UK Census Editing Strategy Heather Wagstaff and Steven Rogers Methodology Directorate Office for National Statistics, U.K.
The development of a data editing and imputation tool set UN/ECE Work Session on Statistical Data Editing Topic (ii): Global solutions to editing Claude.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Discussion Discussants: Rudi.
1 Handbook on Population and Housing Census Editing Department of Economic and Social Development United Nations Statistics Division Studies in Methods,
Session topic (i) – Editing Administrative and Census data Discussants Orietta Luzi and Heather Wagstaff UNECE Worksession on Statistical Data Editing.
4-6 September 2013, Vilnius Quality in Statistics: Administrative Data and Official Statistics USING ADMINISTRATIVE DATA SOURCES IN OFFICIAL.
Looking for statistical twins
Census Mobile Data Capture Using CSPro in Lesotho
Editing and Imputing Income Data in the 2008 Integrated Census prepared by Yael Klejman Israel Central Bureau of Statistics Good afternoon, my name.
Jürgen C Schmidt, Deputy Head, Public Health Data Science
3.1 Fundamentals of algorithms
Generic Statistical Data Editing Models (GSDEMs)
Theme (i): New and emerging methods
The treatment of uncertainty in the results
Social Research Methods
UNECE Seminar on New Frontiers for Statistical Data Collection, Geneva
Creation of synthetic microdata in 2021 Census Transformation Programme (proof of concept) Robert Rendell.
United Nations World Programme of Population and Housing Censuses
Modeling approaches for the allocation of costs
Integrating administrative data – the 2021 Census and beyond
Canadian Census E&I – Lessons Learned from 2006 with Plans for 2011
Census of Population & Housing 2001 Sri Lanka
UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,
Rudi Seljak, Aleš Krajnc
Editing and Imputing Income Data in the 2008 Integrated Census prepared by Yael Klejman Israel Central Bureau of Statistics UNITED NATIONS ECONOMIC.
11-14 January, 2016 Addis Ababa, Ethiopia
UNECE Work Session on Statistical Data Editing
Social Research Methods
Access to European microdata for scientific purposes
Guidelines on the use of estimation methods for the integration of administrative sources DIME/ITDG meeting 2018/02/22.
Survey phases, survey errors and quality control system
Survey phases, survey errors and quality control system
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
The European Statistical Training Programme (ESTP)
6A Types of Data, 6E Measuring the Centre of Data
Generic Statistical Business Process-Censuses
Data processing German foreign trade statistics
LAMAS Working Group 6-7 December 2017
Member States' starting points for modernisation: results of a survey
Modeling and Analysis Tutorial
The role of metadata in census data dissemination
Eurostat WG on Population and Housing Censuses
Treatment of Missing Data Pres. 8
Social Research Methods
Karin Blix, Statistics Denmark,
Modular Approach Agricultural Census
Creating a synthetic database for research in migration and subjective well-being Statistical Matching techniques for combining the complementary questionnaires.
Chapter 13: Item nonresponse
Technical Coordination Group, Zagreb, Croatia, 26 January 2018
Presentation transcript:

Theme (ii): New Data Sources and Census Alexander Kowarik and Thomas Deroyon

Introduction Several countries make heavy use of administrative data in the production of their census, which poses additional challenges in terms of methodological problems and appropriate solutions. This point in time is an ideal occasion for discussing results, ideas and tests, related to methodological developments that have been carried out in this area

Germany : Possible imputation procedures for the Census 2021 Presentations Austria: Improving the Census Core Topic Occupation by using new administrative data sources Germany : Possible imputation procedures for the Census 2021 ************************** Break ************************** Israel: Editing and Imputing Income Data in Integrated Census: lessons learned from the 2008 Census – toward the Census 2020 USA: Creating an initial donor pool for new questions in the Census of Agriculture

S. Koenig: Improving the Census Core Topic Occupation by using new administrative data sources Register-based census using only administrative data Focus on the occupation code variable Use of a large number of administrative files covering the whole population Two major issues: Coding of text information in each file Combining information available in the different files sometimes on the same population

L. Spiess: Possible imputation procedures for the Census 2021 Census combining register with survey data 2011 Census used a combination of cold-deck / deductive / nearest- neighbour imputation methods For 2021 Census, reflexion on new imputation methods allowing: exact variance estimation easy integration into FSO's workflow, especially with validation tools Three possible imputation methods:  Multiple imputation: exact variance calculation / time-consuming / need users specific tools NIM Algorithm (Canceis): very well developped solution / black- box closed tool difficult to fit to specific needs Nearest-neighbour imputation used for 2011 Census: less developped than Canceis / easy interaction with validation tools / possible enhancements to make it a generic editing tool

Combination of register and survey data Y. Klejman: Editing and imputing income data in integrated Census: lessons learned from the 2008 Census – toward the 2020 Census Combination of register and survey data Information on income coming from administrative files Need to develop specific E & I methods: to deal with income dispersion and specific populations while controlling income's distribution on the population Three emphasized methodological questions: Assessment of discrepancies between Census and administrative information on activity status Income imputation for non-covered subpopulations (mean imputation / random regression imputation) Covered population (NIM algorithm) Income editing for Secrecy management for highest incomes with trust in income values found in administrative data

Imputation in the Census of Agriculture (COA): D. Miller: Creating an initial donor pool for new questions in the Census of Agriculture Imputation in the Census of Agriculture (COA): editing and imputations performed as data enter the system combination of deductive / historic / nearest- neighbour imputations donor pools initiated with former censuses and tests adaptations of donor pools to new validated answers New questions on decision-making added to the 2017 Census: need to initialise a donor pool without any past information use of fully conditional specification methods implemented in IVEware to initiate donor pools validation by COA E & I team with members of methodology division and subject-matter experts

Discussion Are Census datasets « special » so the treatment of E & I is different from surveys ? How important is error estimation for Census?Is there a need for quantitative error measurement ? Is the imputation error a substantial part of the error ?