Topic (i): Selective editing / macro editing Discussants Orietta Luzi - Italian National Statistical Institute Rudi Seljak - Statistical Office of Slovenia.

Slides:



Advertisements
Similar presentations
Work Session on Statistical Data Editing Paris, France, April 2014 Topic (i): Selective editing / macro editing Experiences from Selective Editing.
Advertisements

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
1 Workshop on a European Masters in Official Statistics Natalie Shlomo University of Southampton.
Creating Research proposal. What is a Marketing or Business Research Proposal? “A plan that offers ideas for conducting research”. “A marketing research.
Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,
E&I of administrative data used for producing business statistics Vera Costa, Frances Krsinich, Rudi Van der Mescht 2008 UNECE Work Session on Statistical.
United Nations Economic Commission for Europe Statistical Division Applying the GSBPM to Business Register Management Steven Vale UNECE
Vienna, 23 April 2008 UNECE Work Session on SDE Topic (v) Editing on results (post-editing) 1 Topic (v): Editing based on results Discussants: Maria M.
Sudan Experience on Poverty Survey Somaia K.E.Omer Date 7-8 Aug بسم الله الرحمن الرحيم.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
Work Package 5: Integrating data from different sources in the production of business statistics Daniel Lewis Office for National Statistics (UK)
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic The use of administrative data sources (experience and challenges)
Joint UNECE/Eurostat Meeting on Population and Housing Censuses (28-30 October 2009) Accuracy evaluation of Nuts level 2 hypercubes with the adoption of.
Rudi Seljak, Metka Zaletel Statistical Office of the Republic of Slovenia TAX DATA AS A MEANS FOR THE ESSENTIAL REDUCTION OF THE SHORT-TERM SURVEYS RESPONSE.
Quality assurance activities at EUROSTAT CCSA Conference Helsinki, 6-7 May 2010 Martina Hahn, Eurostat.
1 Informing a Data Revolution Getting the right data, to the right people, at the right time, on the right format Johannes Jütting, PARIS21 Tunis, 8 Decemeber.
1 RBM Background Development aid is often provided on a point to point basis with no consistency with countries priorities. Development efforts are often.
Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.
Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.
Deliverable 2.6: Selective Editing Hannah Finselbach 1 and Orietta Luzi 2 1 ONS, UK 2 ISTAT, Italy.
Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.
A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.
The application of selective editing to the ONS Monthly Business Survey Emma Hooper Office for National Statistics
Topic (ii): New and Emerging Methods Maria Garcia (USA) Jeroen Pannekoek (Netherlands) UNECE Work Session on Statistical Data Editing Paris, France,
Eurostat The impact of the Memobust project results.
Jeroen Pannekoek - Statistics Netherlands Work Session on Statistical Data Editing Oslo, Norway, 24 September 2012 Topic (I) Selective and macro editing.
Recommended Practices for Editing and Imputation in the European Statistical System: the EDIMBUS Project* Orietta Luzi (Istat, Italy) Ton De Waal (Statistics.
Topic (vi): New and Emerging Methods Topic organizer: Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Oslo, Norway, September 2012.
Statistics New Zealand - Statistics Netherlands Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011 Topic (v) Changing organizational.
Census Quality: another dimension! Paper for Q2008 conference, Rome Louisa Blackwell Quality Assurance Manager, 2011 Census.
CHAPTER 12 Descriptive, Program Evaluation, and Advanced Methods.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
Land Governance and Security of Tenure in Developing Countries White paper of the French Development cooperation LAND POLICIES AND MDGS IN RESPONSE TO.
Supporting Researchers and Institutions in Exploiting Administrative Databases for Statistical Purposes: Istat’s Strategy G. D’Angiolini, P. De Salvo,
Session topic (iii) – Editing and Imputation in the context of data integration from multiple sources and mixed modes Discussants Felipa Zabala, Orietta.
Modernisation of Statistics Production Stockholm November 2009 Summary and Conclusions New York 24 February 2010 Mats Wadman Deputy Director General Statistics.
Topic (iii): Macro Editing Methods Paula Mason and Maria Garcia (USA) UNECE Work Session on Statistical Data Editing Ljubljana, Slovenia, 9-11 May 2011.
Outlining a Process Model for Editing With Quality Indicators Pauli Ollila (part 1) Outi Ahti-Miettinen (part 2) Statistics Finland.
WYE CITY GROUP on Statistics on Rural Development and Agricultural Household Income Naman Keita FAO, Statistics Division Way forward for the Wye City Group:
Regional Seminar on Promotion and Utilization of Census Results and on the Revision on the United Nations Principles and Recommendations for Population.
Experience and response in developing countries: the twinning project with the Tunisian National Statistical Institute Monica Consalvi ISTAT, Division.
Core Principles and Action Plan February 4, 2004.
Multivariate selective editing via mixture models: first applications to Italian structural business surveys Orietta Luzi, Guarnera U., Silvestri F., Buglielli.
1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway
New and Emerging Methods UN/ECE Work Session on Statistical Data Editing Vienna April 21-23, 2008.
Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
QUALITY ASSESSMENT OF THE REGISTER-BASED SLOVENIAN CENSUS 2011 Rudi Seljak, Apolonija Flander Oblak Statistical Office of the Republic of Slovenia.
INTEGRATED STRATEGIC PLANNING PROCESS (ISPP) 10 year planning outlook10 year planning outlook Monia Lahaie, DCFO and Director General Finance at Statistics.
Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.
A Strategy for Implementation of the Updated System of National Accounts 1993 Prepared for discussion by UNSD and IMF Joint Eurostat-UNSD Conference on.
Continual Service Improvement Methods & Techniques.
An Overview of Editing and Imputation Methods for the next Italian Censuses Gianpiero Bianchi, Antonia Manzari, Alessandra Reale UNECE-Eurostat Meeting.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Discussion Discussants: Rudi.
Ljubljana, 11 Mai 2011UNECE Work session on SDE Topic (vii) New and emerging methods 1 Topic (vii): New and emerging methods Introduction Session organizers:
Development Account: 6th Tranche Strengthening the capacity of National Statistical Offices (NSOs) in the Caribbean Small Island Developing States to fulfill.
4–6 September 2013, Vilnius, Lithuania High-Level Seminar for Eastern Europe, Caucasus and Central Asia Countries QUALITY FRAMEWORK AT.
Session topic (i) – Editing Administrative and Census data Discussants Orietta Luzi and Heather Wagstaff UNECE Worksession on Statistical Data Editing.
Theme (v): Managing change
Generic Statistical Data Editing Models (GSDEMs)
Enhancing employers’ involvement in Social Protection policy debates
UNITED NATIONS ECONOMIC COMMISSION FOR EUROPE CONFERENCE OF EUROPEAN STATISTICIANS Work Session on Statistical Data Editing April 2017 The Hague,
Improving the efficiency of editing in ONS business surveys
Telling Canada’s story in numbers ICCSMD Statistics Canada
Overview of Approaches to Register-Based Populating Censuses
DG Troika – 26 October – Portugal
Étienne Saint-Pierre, Statistics Canada
UNECE Work Session on Statistical Data Editing, Paris, 2014
Integrating Gender into Rural Development M&E in Projects and Programs
Presentation transcript:

Topic (i): Selective editing / macro editing Discussants Orietta Luzi - Italian National Statistical Institute Rudi Seljak - Statistical Office of Slovenia Pedro Revilla - National Statistical Institute of Spain UNECE Work session on SDE, Paris, April 2014

Topic (i) Selective editing / macro editing Background The adoption of selective editing / macro editing approaches can significantly improve the efficiency of the data editing process This is especially true in the case of business surveys where usually a small amount of measurement errors have a decisive influence on the final results and therefore the appropriate usage of selective editing and macro editing techniques can significantly reduce the cost of the data editing process with no major impact on the quality of the final results Developing tools implementing selective editing models/functions may validly support further harmonization and widening use of efficient editing strategies in NSIs UNECE Work session on SDE, Paris, April 2014

Topic contents – Practical implementation of local and global score functions – Integration of selective editing / macro editing techniques within the statistical process – Tools to support selective editing / macro editing, including visualization approaches – Validation of selective editing strategies, inference issues – Editing of unstructured data UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

Long Presentations Italy - Use of administrative data for selective editing: the case of business investments Spain - Score Functions under the Optimization Approach United Kingdom – Maintenance of Selective Editing in ONS Business Surveys UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

Short Presentations Sweden – Experiences from Selective Data Editing at Statistics Sweden France – Selective Editing Techniques and Seasonal Adjustment of Short- Term Economic Indicators France – Using R-indicators to monitor household surveys and prioritize data collection: an application to the 2010 Household Wealth survey in France Japan – An Assessment of Automatic Editing via the Contamination Model and Multiple Imputation United States – Text Analysis Tools for Editing and Verification Sweden – Adjusting for Remaining Measurement Errors after Selective Editing UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

Short Presentations Sweden – Adjusting for Remaining Measurement Errors after Selective Editing (T. Laitila, A. Norberg) Model-based approach for bias correction of estimators due to the remaining errors in selective edited data sets, where the observed measurement errors in the edited units are related to their scores. The estimated models are used to predict measurement errors in unedited units and their associated bias. Experimental application to data of the sample survey on establishments and their salary payments to employees carried on at Statistics Sweden. UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

Topic (i): Selective editing / macro editing Discussion UNECE Work session on SDE, Paris, April 2014

Overall summary Session papers provide a wide-ranging overview of current research and development activities in the area of selective / macro editing carried out at various NSIs with the aim of enhancing the efficiency of survey editing strategies Theoretical formalizations of the selective editing paradigm are proposed, in a situation where no accepted theory has been developed in this area yet ; demanding modelling problems come out from presentations The need of a common theoretical evaluation framework for quality assessment of selectively edited data is an area requiring further research at also an international perspective Issues related to the development and dissemination inside NSIs of “generalized” IT-tools for selective editing are discussed, with specific attention to those relating to applicability, maintenance and optimization of the implemented methods/models New application contexts where selective / macro editing principles can contribute to most efficient statistical production processes are explored

9 Points for discussion –Integrating selective / macro editing in existing E&I process Advantages (increased efficiency, burden reduction,…) Costs (re-design of processes, models/parameters maintenance/update due to changes of populations/information contexts, …) Cultural issues (changes in attitude needed, importance of support by the survey staff, importance of constant training and education,…) Countries’ experiences Papers from Italy, Japan, UK, Sweden (A. Norberg) UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

10 Points for discussion –Formalization of selective editing Ad hoc methods VS theoretical frameworks How to estimate the model parameters? How do we apply the developed frameworks in practice? Papers from Italy and Spain UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

11 Points for discussion –Standard tools for selective editing Advantages (costs savings, harmonization, easy to document and to update, …) Drawbacks (specificity against generalization, validity of models assumptions, “black-box” effect, ….) International co-operation, sharing solutions SeleMix (papers from Italy, Japan), Selekt (papers from Sweden, UK) UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

12 Points for discussion –Selective and macro editing and administrative data Potentials (use of admin data as auxiliary information for error modeling/error detection/error correction) Direct use of admin data for estimation purposes: feasibility, costs, role of selective / macro editing Paper from Italy UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

13 Points for discussion –Assessing the validity of a selective / macro editing strategy Which indicators, quality measures, evaluation approaches Inference and quality assessment under selectively edited data Countries’ experiences Paper from Italy, Sweden (Laitila-Norberg) UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing

14 Points for discussion –New, innovative approaches in selective / macro editing strategy Editing of unstructured data by using text analyses tools Using R-indicators for prioritization of follow-up Countries’ experiences Paper from United States, France (Merly-Alpa) UNECE Work session on SDE, Paris, April 2014 Topic (i) Selective editing / macro editing