Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Discussion Discussants: Rudi.

Slides:

Advertisements

Similar presentations

Integrated Data Editing and Imputation Ton de Waal Department of Methodology Voorburg Statistics Netherlands ICES III conference, Montréal June 19, 2007.

Advertisements

Some considerations on developing a DWH for SBS estimates Orietta Luzi – Mauro Masselli Istat - Italy march 2013.

CBS-SSB STATISTICS NETHERLANDS – STATISTICS NORWAY Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011 Jeroen Pannekoek and Li-Chun.

Ensemble Methods An ensemble method constructs a set of base classifiers from the training data Ensemble or Classifier Combination Predict class label.

Deliverable 2.8: Outliers Gary Brown Office for National Statistics UK.

SLICE 1.5: A software framework for automatic edit and imputation Ton de Waal Statistics Netherlands UN/ECE Work Session on Statistical Data Editing,

Tax Policy Center | Comments: Measuring the Tax Gap Eric Toder Urban-Brookings Tax Policy Center June 21, 2012.

COMPUTER AIDED DIAGNOSIS: FEATURE SELECTION Prof. Yasser Mostafa Kadah –

UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.

1 Editing Administrative Data and Combined Data Sources Introduction.

CDR recommendations. General overview Coalesce & Clarify & Combine –Significant overlap and redundancies –This list of recommendations is very useful.

Impact Evaluation Session VII Sampling and Power Jishnu Das November 2006.

Edit and Imputation of the 2011 Abu Dhabi Census Glenn Hui and Hanan AlDarmaki Statistics Centre - Abu Dhabi UNECE CES Work Session on Statistical Data.

Vienna, 23 April 2008 UNECE Work Session on SDE Topic (v) Editing on results (post-editing) 1 Topic (v): Editing based on results Discussants: Maria M.

Eurostat Statistical Data Editing and Imputation.

Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.

Work Package 5: Integrating data from different sources in the production of business statistics Daniel Lewis Office for National Statistics (UK)

Rudi Seljak, Metka Zaletel Statistical Office of the Republic of Slovenia TAX DATA AS A MEANS FOR THE ESSENTIAL REDUCTION OF THE SHORT-TERM SURVEYS RESPONSE.

UNITED NATIONS - ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing Use of administrative data.

Cristian Urs and Ben Riveira. Introduction The article we chose focuses on improving the performance of Genetic Algorithms by: Use of predictive models.

THE MAIN INNOVATIONS OF DATA EDITING AND IMPUTATION FOR THE 2010 ITALIAN AGRICULTURAL CENSUS G. Bianchi, R. M. Lipsi, P. Francescangeli, G. Ruocco, A.

Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.

Deliverable 2.6: Selective Editing Hannah Finselbach 1 and Orietta Luzi 2 1 ONS, UK 2 ISTAT, Italy.

Imputation and Editing of Income from the Administrative File in Israel ’ s Censuses prepared by Orly Furman and Dmitri Romanov UNITED NATIONS ECONOMIC.

New and Emerging Methods Maria Garcia and Ton de Waal UN/ECE Work Session on Statistical Data Editing, May 2005, Ottawa.

Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,

1 Assessing the Impact of SDC Methods on Census Frequency Tables Natalie Shlomo Southampton Statistical Sciences Research Institute University of Southampton.

Jeroen Pannekoek - Statistics Netherlands Work Session on Statistical Data Editing Oslo, Norway, 24 September 2012 Topic (I) Selective and macro editing.

European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.

Recommended Practices for Editing and Imputation in the European Statistical System: the EDIMBUS Project* Orietta Luzi (Istat, Italy) Ton De Waal (Statistics.

Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.

First topic: clustering and pattern recognition Marc Sobel.

WP 19 Assessment of Statistical Disclosure Control Methods for the 2001 UK Census Natalie Shlomo University of Southampton Office for National Statistics.

Session topic (iii) – Editing and Imputation in the context of data integration from multiple sources and mixed modes Discussants Felipa Zabala, Orietta.

CBS-SSB STATISTICS NETHERLANDS – STATISTICS NORWAY Work Session on Statistical Data Editing Oslo, Norway, September 2012 Jeroen Pannekoek and Li-Chun.

A discussion of Comparing register and survey wealth data ( F. Johansson and A. Klevmarken) & The Impact of Methodological Decisions around Imputation.

Eurostat Weighting and Estimation. Presented by Loredana Di Consiglio Istituto Nazionale di Statistica, ISTAT.

Lyne Guertin Census Data Processing and Estimation Section Social Survey Methods Division Methodology Branch, Statistics Canada UNECE April 28-30, 2014.

Topic (iii): Macro Editing Methods Paula Mason and Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.

Topic (i): Selective editing / macro editing Discussants Orietta Luzi - Italian National Statistical Institute Rudi Seljak - Statistical Office of Slovenia.

Multivariate selective editing via mixture models: first applications to Italian structural business surveys Orietta Luzi, Guarnera U., Silvestri F., Buglielli.

Eurostat Accuracy of Results of Statistical Matching Training Course «Statistical Matching» Rome, 6-8 November 2013 Marcello D’Orazio Dept. National Accounts.

New and Emerging Methods UN/ECE Work Session on Statistical Data Editing Vienna April 21-23, 2008.

Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.

The 2011 Census: Estimating the Population Alexa Courtney.

Automatic Editing Data. A New Version of DIA System Prepared by J.M. Gomez Presented by D.Lorca National Statistical Institute of Spain.

The development of a data editing and imputation tool set UN/ECE Work Session on Statistical Data Editing Topic (ii): Global solutions to editing Claude.

An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Introduction Session organizers:

Guillaume Osier Institut National de la Statistique et des Etudes Economiques (STATEC) Social Statistics Division Construction.

Kernel Based Anomaly Detection Andrew Arnold (aoa5) 2nd Annual Project Student Day Columbia University -- 4/26/01 Intrusion Detection Systems -- IDS Machine.

Session topic (i) – Editing Administrative and Census data Discussants Orietta Luzi and Heather Wagstaff UNECE Worksession on Statistical Data Editing.

Theme (iv): Standards and international collaboration

Theme (v): Managing change

Generic Statistical Data Editing Models (GSDEMs)

Theme (i): New and emerging methods

Theme (ii): New Data Sources and Census

CH 5: Multivariate Methods

An R package for selective editing based on a latent class model

UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,

Maximum Likelihood & Missing data

Estimation methods for the integration of administrative sources

Slides for Introduction to Stochastic Search and Optimization (ISSO) by J. C. Spall CHAPTER 15 SIMULATION-BASED OPTIMIZATION II: STOCHASTIC GRADIENT AND.

Data processing German foreign trade statistics

Sampling and estimation

A bootstrap method for estimators based on combined administrative and survey data Sander Scholtus (Statistics Netherlands) NTTS Conference 13 March 2019.

Automatic Editing with Soft Edits

Implementation of the Bayesian approach to imputation at SORS Zvone Klun and Rudi Seljak Statistical Office of the Republic of Slovenia Oslo, September.

A handbook on validation methodology. Metrics.

New and Emerging Methods

Presentation transcript:

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Discussion Discussants: Rudi Seljak / SORS Daniel Kilchmann / SFSO

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 2 Summary of papers (1) WP.40: Partial (donor) imputation with adjustments (Netherlands, Norway) Discussion of different distance metrics to perform minimal adjustments to imputed data in order to guarantee consistency. WP.41: A forward search algorithm for compositional data (Italy) Discussion of a procedure for detecting outliers in compositional data.

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 3 Summary of papers (2) WP.42: Automatic editing with soft edits (Netherlands) New formulation of the error localisation problem including hard and soft edits and its solution with a branch-and-bound algorithm. WP.43: On imputation of binary variables in registers (Sweden) Discussion of random imputation versus deterministic imputation in the case of imputing binary variables with respect to accuracy leading to a recommendation which method to use.

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 4 Summary of papers (3) WP.44: Imputation and editing of income from the administrative file in the Census (Israel) Procedure adopted to overcome the deficiencies of Census and administrative data in the case of imputing income. WP.45: An R package for selective editing based on a latent class model (Italy) Discussion of the use of the R package SeleMix where a method taking explicitly the probability of being in error and the error impact into account is implemented.

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 5 Paper-Specific Questions

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 6 Paper-Specific Questions WP.40: Partial (donor) imputation with adjustments (Netherlands) –What happens if the only reported value is 0? –Is it possible to include domains (e.g. salary boundaries per education level)? WP.41: A forward search algorithm for compositional data (Italy) –Efficiency of the method (true, false) x (detected, undetected)? –Does the method work if there are lots of zeros in the data?

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 7 Paper-Specific Questions WP.42: Automatic editing with soft edits (Netherlands) –Is there already a strategy or idea how to define the cost of failed soft edit rules? –Advances in the implementation? WP.43: On imputation of binary variables in registers (Sweden) –Why not use multiple imputation instead of repeated random imputation? –The risk of bias and the loss of variance for deterministic imputation and the loss of efficiency for random imputation increases for small sub-populations. Limitation for imputation in general?

Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 8 Paper-Specific Questions WP.44: Imputation and editing of income from the administrative file in the Census (Israel) –Is it possible to validate the strategy adopted by the insurance salary data base 2009? WP.45: An R package for selective editing based on a latent class model (Italy) –When will the R package be available on the Cran library?