Quality Challenges in Modernising Official Business Statistics Ger Snijkers (Statistics Netherlands) Gustav Haraldsen (Statistics Norway) Martin Luppes.

Slides:

Advertisements

Similar presentations

Page 1 Measuring Survey Quality through Representativity Indicators using Sample and Population based Information Chris Skinner, Natalie Shlomo, Barry.

Advertisements

Multiple Indicator Cluster Surveys Data Dissemination - Further Analysis Workshop Basic Concepts of Further Analysis MICS4 Data Dissemination and Further.

1 Measuring data quality by the use of a routine re-interview module Experiences from the Norwegian European Social Survey Øyvin Kleven and Frode Berglund.

Will ‘big data’ transform official statistics?

Input Data Warehousing Canada’s Experience with Establishment Level Information Presentation to the Third International Conference on Establishment Statistics.

Fulvia Cerroni - Serena Migliardo - Enrica Morganti Italian National Institute of Statistics Session 27: Use of administrative sources I Helsinki 5 May.

Frank Yu Australian Bureau of Statistics Unstructured Data 1.

Thursday, 10 July, 2008Q2008, 8-11 July 2008, Rome1 Getting Data for Business Statistics: A Response Model for Business Surveys Ger Snijkers Statistics.

CZECH STATISTICAL OFFICE | Na padesatem 81, Prague 10 | Jitka Prokop, Czech Statistical Office SMS-QUALITY The project and application.

M. Fall, JP. Lorgnet et alii 26/02/2010 Individual Dynamics of Poverty, a study tackling changes in poverty in France via the SILC survey.

Statistics on enterprise groups – the EGR potential European Commission – Eurostat Directorate G: Global business statistics.

United Nations Economic Commission for Europe Statistical Division Standards-based Modernisation An update on the work of the High-level Group for the.

International Seminar on Modernizing Official Statistics:

Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,

Assessing Statistical Systems Graham Eele – World Bank, Development Data Group.

The Future of Statistical Data Collection? Challenges and Opportunities Johan Erikson (Statistics Sweden) Gustav Haraldsen (Statistics Norway) Ger Snijkers.

ICES III - Johan Erikson1 Effects of offering web questionnaires as an option in enterprise surveys – The Swedish experience Johan Erikson Statistics Sweden.

TYPOLOGY OF PRODUCTS IN OFFICIAL STATISTICS Thomas Burg Marcus Hudec.

List frames area frames and administrative data, are they complementary or in competition? Elisabetta Carfagna University of Bologna Department of Statistics.

International Sourcing Moving Business Functions abroad Peter Bøegh Nielsen Statistics Denmark.

ESSnet Workshop Rome December Rome 2012 Memobust: harmonisation and integration issues Rob van de Laar Division of Process development, IT and Methodology.

Quality issues on the way from survey to administrative data: the case of SBS statistics of microenterprises in Slovakia Andrej Vallo, Andrea Bielakova.

"Automated data collection in accommodation statistics: a European overview" Rome, 3 rd December 2012.

Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.

Modernisation and Quality of Business Statistics – NSI Perspective Ger Snijkers (Statistics Netherlands) Gustav Haraldsen (Statistics Norway) EESW, 9-11.

We provide information Comparing income data from survey and register Richard Heuberger Statistics Austria Directorate Social Statistics.

Q2014 – Special Session Big Data Vienna, 4 June 2014 Quality Approaches to Big Data Peter Struijs and Piet Daas.

A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.

The MEMOBUST project Ágnes Andics EESW Nürnberg 1.

Interoperable Visualization Framework towards enhancing mapping and integration of official statistics Haitham Zeidan Palestinian Central.

Towards a more efficient system of administrative data management and quality evaluation to support statistics production in Istat Grazia Di Bella, Simone.

29 February 2012 Inter-Agency Group on Economic and Financial Statistics (IAG) and the G-20 Data Gaps Initiative Laurs Nørlund Director - National Accounts,

Item III.2 Frame population EGR frame methodology Barry Coenen, Statistics Netherlands MEETS Conference June 2014.

for statistics based on multiple sources

Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.

>>. ESSnet Measuring Global Value Chains 1.Globalisation indicators 2.Methodological development and support for International Organisation and Sourcing.

Session topic (iii) – Editing and Imputation in the context of data integration from multiple sources and mixed modes Discussants Felipa Zabala, Orietta.

Handbook on Precision Requirements and Variance Estimation for ESS Household Surveys Denisa Florescu, Eurostat European Conference on Quality in Official.

Addressing the challenge of producing European comparable data using administrative data Mihaela AGAFIŢEI Sorina VÂJU UNECE Seminar on Statistical Data.

United Nations Economic Commission for Europe Statistical Division High-Level Group Achievements and Plans Steven Vale UNECE

Why register-based statistics? Eric Schulte Nordholt Statistics Netherlands Division Social and Spatial Statistics Department Support and Development Section.

CES Seminar on “Organization of data collection and sharing, and the management challenges for the implementation of SDMX” Session 1 Hank Hermans CES /

1 For a Population Statistical Register Characteristics and Potentials for the Official Statistics Central department for administrative data and archives.

Data Collection and Data Sharing at Statistics Netherlands Prof. dr. Ger Snijkers * UNECE CES seminar I Geneva, 14 June 2011.

ESS-net DWH ESSnet on microdata linking and data warehousing in statistical production Harry Goossens – Statistics Netherlands Head Data Service Centre.

1 Unstructured Data (UD) What is unstructured data? How is it statistically valuable? Challenges of turning UD into information.

Generic Statistical Data Editing Models (GSDEMs) Workshop on the Modernisation of Official Statistics The Hague, 24 November 2015.

Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries 3-5 February 2014, Castries,

QUALITY ASSESSMENT OF THE REGISTER-BASED SLOVENIAN CENSUS 2011 Rudi Seljak, Apolonija Flander Oblak Statistical Office of the Republic of Slovenia.

Q2010 Special session 34 Data quality and inference under register information Discussion by Carl-Erik Särndal.

1 European Conference on Quality in Official Statistics - Helsinki. Finland 3-6 May 2010 The use of R-indicators in responsive survey design – Some Norwegian.

The combined use of multiple data sources in the population census Fabio Crescenzi, Giuseppe Sindoni National Institute of Statistics Rome, Italy

Workshop on Passenger Mobility Conclusions. EU data requirements – DG MOVE  Environmental, economic and social considerations require close monitoring.

Adjusting for coverage error in administrative sources in population estimation Owen Abbott Research, Development and Infrastructure Directorate.

ROMA 23 GIUGNO 2016 MODERNISATION LAB - FOCUSSING ON MODERNISATION STRATEGIES IN EUROPE: SOME NSIs’ EXPERIENCES Giulio Barcaroli – Lessons learnt and conclusion.

1 Experience in measuring the burden on businesses Peter Bekx Director, Business Statistics IAOS Conference Shanghai, October 2008.

UNECE Data Integration Project

Towards more flexibility in responding to users’ needs

Business Demography Indicators for the euro area

Session D12: Multisource statistics New sources: new modelling approaches Author: Gras Fabrice, Eurostat, unit B1, Methodology and corporate architecture.

Methodology and Corporate Architecture

Gustav Haraldsen, Ger Snijkers, Elisabeth Falnes-Dalheim

Sub-regional workshop on integration of administrative data, big data

6.1 Quality improvement Regional Course on

Martine Durand and Angela Me

Overview of Approaches to Register-Based Populating Censuses

Big Data ESSNet WP 1: Web scraping / Job Vacancies Pilot

The new quality strategy in the modernised Italian National Statistical Institute Giovanna Brancato Giorgia Simeoni, Antonia Boggia,

Kees Zeelenberg, Winfried Ypma, Peter Struijs; Statistics Netherlands

Use of administrative data for statistical purposes

Presentation transcript:

Quality Challenges in Modernising Official Business Statistics Ger Snijkers (Statistics Netherlands) Gustav Haraldsen (Statistics Norway) Martin Luppes (Statistics Netherlands) Piet Daas (Statistics Netherlands) Johan Erikson (Statistics Sweden) Li-Chun Zhang (Statistics Norway/University of Southampton) Q2014: European Conference on Quality in Official Statistics 2 – 5 June 2014, Vienna, Austria

Quality Framework: Quality Diamond Q2014, 3 June 2014, Vienna, Autria 2 Total survey error sources: Sampling errors Non- sampling errors Quality effects related to the survey design set by: Stakeholders Production process Business context and response process of outputs

Two fundamental changes Q2014, 3 June 2014, Vienna, Autria 3 Commercialization of statistics Globalization 1.The dynamic structure of Enterprise groups 2.The origins of inputs and destination of outputs 3.Business functions across boarders 4.Measuring Value chains

Two fundamental changes: effects Q2014, 3 June 2014, Vienna, Autria 4 Commercialization of statistics Globalization 1.The dynamic structure of Enterprise groups 2.The origins of inputs and destination of outputs 3.Business functions across boarders 4.Measuring Value chains 1.Different statistics Sturgeon (2013): “We have a strong sense of changes in the world economy, […] but cannot fully describe the new patterns and structures […], not least because the official statistics at our disposal were created for other purposes and in simpler times!”

Two fundamental changes: effects Q2014, 3 June 2014, Vienna, Autria 5 Commercialization of statistics Globalization 1.The dynamic structure of Enterprise groups 2.The origins of inputs and destination of outputs 3.Business functions across boarders 4.Measuring Value chains 1.Different statistics 2.Different ways of producing statistics Updating multi-source/ mixed-mode strategies: Using available data Secondary sources: registers and big data Modernising survey methodology

Data sources and (dis)qualities Q2014, 3 June 2014, Vienna, Autria 6 SurveysAdmin dataBig data Data source LocalCentralHuman sourced Process mediated Machine generated QualitiesDesigned Multivariate Complete Low cost Timeliness Real time updates DisqualitiesNonresponse bias Measurement errors Expensive Validity? Updated? No control Coverage bias Measurement errors Lean in variables No control Globalization Commercialization

Tentative conclusions Q2014, 3 June 2014, Vienna, Autria 7 SurveysAdmin dataBig data Data source LocalCentralHuman sourced Process mediated Machine generated QualitiesDesigned Multivariate Complete Low cost Timeliness Real time updates DisqualitiesNonresponse bias Measurement errors Expensive Validity? Updated? No control Coverage bias Measurement errors Lean in variables No control 1.Starting point: develop new statistical indicators and statistical system at country and European level (e.g. FRIBS) 2.Data warehousing of already available data 3.Integration of these data, including business and household data 4.Study new sources within the context of the new statistical system; use the qualities of each source in a blended approach 5.Use surveys to collect additional information about the Value Chains 6.Modernise business surveys: tailor sample units and measurement instruments to the business production process Aimed at updating the multi-source/mixed-mode strategy Globalization Commercialization

Tentative conclusions Q2014, 3 June 2014, Vienna, Autria 8 SurveysAdmin dataBig data Data source LocalCentralHuman sourced Process mediated Machine generated QualitiesDesigned Multivariate Complete Low cost Timeliness Real time updates DisqualitiesNonresponse bias Measurement errors Expensive Validity? Updated? No control Coverage bias Measurement errors Lean in variables No control Groves (2013): “We are living in exciting times: it is up to us to build a new paradigm for official statistics. We have work to do!” Aimed at updating the multi-source/mixed-mode strategy Globalization Commercialization