E&I for 2006 Canadian Census Mike Bankier Statistics Canada

Slides:



Advertisements
Similar presentations
Slide 1Slide Slide 1 International Conference on Establishment Surveys III Montreal June 18-21, 2007 United States Department of Agriculture National Agricultural.
Advertisements

DLI Training Nesstar Workshop
1 Editing the Integrated Census in Israel. EDITING THE INTEGRATED CENSUS IN ISRAEL Prepared by Eva Rotenberg, Central Bureau of Statistics, Israel (1)
Issues in Designing a Confidentiality Preserving Model Server by Philip M Steel & Arnold Reznek.
The estimation strategy of the National Household Survey (NHS) François Verret, Mike Bankier, Wesley Benjamin & Lisa Hayden Statistics Canada Presentation.
Weighting and Imputation for CORE Social Housing Statistics Julia Bowman & Niall Goulding.
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
24/5/2011 MSIS 2011 – May 2011, Luxembourg 1 Statistical data editing near the source using cloud computing concepts George Pongas, Christine Wirtz.
SADC Course in Statistics Producing Good Tables In Excel Module B2 Sessions 4 & 5.
UNECE Types of censuses, enumeration methods and selected operational aspects: results of the ECE questionnaire Paolo Valente Social and Demographic Statistics.
Go to Table of ContentTable of Content Analysis of Variance: Randomized Blocks Farrokh Alemi Ph.D. Kashif Haqqi M.D.
Edit and Imputation of the 2011 Abu Dhabi Census Glenn Hui and Hanan AlDarmaki Statistics Centre - Abu Dhabi UNECE CES Work Session on Statistical Data.
Regional Seminar on Census Data Archiving for Africa, Addis Ababa, Ethiopia, September 2011 Overview of Archiving of Microdata Session 4 United Nations.
NSI 1 Collect Process AnalyseDisseminate Survey A Survey B Historically statistical organisations have produced specialised business processes and IT.
Role of the information technology in official statistics Juraj RIECAN Director, UN-ESCWA Statistics Division.
Lecture 2 The Data of Macroeconomics, Macroeconomic Accounts 1 1.Measuring the Value of Economic Activity: GDP 2.Measuring the Cost of Living: The CPI.
Econ 3790: Business and Economics Statistics
THE MAIN INNOVATIONS OF DATA EDITING AND IMPUTATION FOR THE 2010 ITALIAN AGRICULTURAL CENSUS G. Bianchi, R. M. Lipsi, P. Francescangeli, G. Ruocco, A.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
SA1 / Operation & support Enabling Grids for E-sciencE Multiplatform grid computation applied to an hyperbolic.
New and Emerging Methods Maria Garcia and Ton de Waal UN/ECE Work Session on Statistical Data Editing, May 2005, Ottawa.
Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,
April 2004 At A Glance CAT is a highly portable exception monitoring and action agent that automates a set of ground system functions. Benefits Automates.
Metadata Architecture at StatCan MSIS 2008 Luxembourg, April 7-9, 2008 Karen Doherty Director General Informatics Branch Statistics Canada.
Innovations in Data Dissemination Thomas L. Mesenbourg, Jr. Acting Director U.S. Census Bureau United Nations Seminar on Innovations in Official Statistics.
Editing a Mixture of Canadian 2006 Census and Tax Data Mike Bankier Statistics Canada 2006 Work Session on Statistical Data Editing
Recommended Practices for Editing and Imputation in the European Statistical System: the EDIMBUS Project* Orietta Luzi (Istat, Italy) Ton De Waal (Statistics.
Metadata driven application for data processing – from local toward global solution Rudi Seljak Statistical Office of the Republic of Slovenia.
The Joint Population Census for Mercosur, Bolivia and Chile: an experience of integration Alicia Bercovich IBGE, Brazil.
Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.
Chapter 7 Interactive Design and Prototyping Human Performance Engineering Robert W. Bailey, Ph.D. Third Edition.
DATA PREPARATION: PROCESSING & MANAGEMENT Lu Ann Aday, Ph.D. The University of Texas School of Public Health.
Quality Assurance Programme of the Canadian Census of Population Expert Group Meeting on Population and Housing Censuses Geneva July 7-9, 2010.
Anne K. Stratton National Center for Health Statistics Centers for Disease Control and Prevention National Center for Health Statistics Re-engineering.
Machine Learning Documentation Initiative Workshop on the Modernisation of Statistical Production Topic iii) Innovation in technology and methods driving.
United Nations Economic Commission for Europe Statistical Division High-Level Group Achievements and Plans Steven Vale UNECE
Implicit Linear Inequality Edits Generation and Error Localization in the SPEER Edit System Maria Garcia U.S. Census Bureau UNECE Work Session on Statistical.
Lyne Guertin Census Data Processing and Estimation Section Social Survey Methods Division Methodology Branch, Statistics Canada UNECE April 28-30, 2014.
Topic (iii): Macro Editing Methods Paula Mason and Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.
Paolo Valente - UNECE Statistical Division Slide 1 Technology for census data coding, editing and imputation Paolo Valente (UNECE) UNECE Workshop on Census.
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Michelle Simard, Thérèse Lalor Statistics Canada CSPA Project Manager UNECE Work Session on Statistical Data Confidentiality Helsinki, October 2015 Confidentialized.
Heather Wagstaff and Thomas Burg Topic (vi) Methodologies for Editing Census Data INTRODUCTION UNECE Work Session on Statistical Data Editing:Vienna
Efficient computerization and management of biological collections and mobilization of specimen information onto the Internet.Efficient computerization.
Developing the prototype Longitudinal Business Database: New Zealand’s Experience Julia Gretton IAOS Conference Shanghai, China, October 2008
Methods and software for editing and imputation: recent advancements at Istat M. Di Zio, U. Guarnera, O. Luzi, A. Manzari ISTAT – Italian Statistical Institute.
1 1 International Collaboration on Industrialization of Editing: Business Case (Part 1, WP38) Li-Chun Zhang Statistics Norway.
New and Emerging Methods UN/ECE Work Session on Statistical Data Editing Vienna April 21-23, 2008.
Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.
The 2011 Census: Estimating the Population Alexa Courtney.
Automatic Editing Data. A New Version of DIA System Prepared by J.M. Gomez Presented by D.Lorca National Statistical Institute of Spain.
Towards the 2011 UK Census Editing Strategy Heather Wagstaff and Steven Rogers Methodology Directorate Office for National Statistics, U.K.
Informatics & Methodology The Transition from GEIS to Banff Chris Mohl, Yves Deguire, Rob Kozak, Chantal Marquis Statistics Canada C anada StatisticsStatistique.
The development of a data editing and imputation tool set UN/ECE Work Session on Statistical Data Editing Topic (ii): Global solutions to editing Claude.
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Introduction Session organizers:
FREQUENCY DISTRIBUTION
1. Methodology of new knowledge creation
Theme (ii): New Data Sources and Census
Canadian Census E&I – Lessons Learned from 2006 with Plans for 2011
UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,
Editing and Imputing Income Data in the 2008 Integrated Census prepared by Yael Klejman Israel Central Bureau of Statistics UNITED NATIONS ECONOMIC.
CIS 210 Systems Analysis and Development
Investigating associations between categorical variables
Process Description Tools
Data processing German foreign trade statistics
Statistical data editing near the source using cloud computing concepts George Pongas, Christine Wirtz -Eurostat.
WRITING AN ALGORITHM, PSEUDOCODE, AND FLOWCHART LESSON 2.
CSPA Specifications Overview
Hands-on GSIM Mauro Scanu ISTAT
Presentation transcript:

E&I for 2006 Canadian Census Mike Bankier Statistics Canada

NIM/CANCEIS Nearest neighbour imputation methodology (NIM) used last 2 Censuses Processes both categorical and numeric variables simultaneously NIM finds nearest neighbours and then detemines minimum number of variables to impute (opposite of Fellegi/Holt) NIM does good job preserving distributions

Where NIM Used 100% 2006 Canadian Census variables Canadian Survey of Household Spending Prototype software used in 2000 Brazil and Swiss Censuses CANCEIS licences signed by UK,USBC, Italy, New Zealand, Brazil, Peru, Australia, NASS, Netherlands, Switzerland, Ukraine

Extensions for 2006 Census In 2001 Census – DOS based system, no Windows interface – able to do minimum change donor imputation – can process coded or numeric variables For 2006 Census – Windows interfaces added – can also do deterministic imputation – alphanumeric variables added

2006 Census Windows Interfaces specify the data dictionary specify edit rules using decision logic tables with access to the data dictionary submit and monitor jobs

Concluding Remarks Finding nearest neighbours and then determining the minimum number of variables to impute has significant computational advantages Specialized windows interfaces makes it much easier to specify edits Developed collaboratively and iteratively over several censuses. Resulted in highly effective and efficient tool.

E&I for 2006 Canadian Census Mike Bankier Statistics Canada