The converging pattern between Business statistics and Administrative data. Towards an “industrialized” statistical production process The Italian LCS2012.

Slides:



Advertisements
Similar presentations
Some considerations on developing a DWH for SBS estimates Orietta Luzi – Mauro Masselli Istat - Italy march 2013.
Advertisements

SERG Universidad de Huelva FACTORS OF BUSINESS SUCCESS IN ANDALUSIA.
Towards a Better Integration of Survey and Tax Data in the Unified Enterprise Survey Claude Turmelle Statistics Canada ICES-III Montréal, Québec, Canada.
GENEralised software for Sampling Estimates and Errors in Surveys (GENESEES V. 3.0) Piero Demetrio Falorsi - Salvatore Filiberti Istat Structural Business.
Rome, 8-9 July European conference on Qualitywww.stat.gov.lt REAL AND IMAGINATIVE RESPONSE BURDEN – DIFFERENT WAYS OF TREATMENT, MEASUREMENT AND.
Results and next steps from the ESSnet Admin Data Alison Pritchard Business Outputs & Developments, Office for National Statistics, UK 4 December 2012.
UNECE Work Session on Statistical Data Editing Vienna April 2008 Topic ii – Editing Administrative Data and Combined Sources.
An Integrated Approach to Economic Statistics “ The Canadian Experience” UNSD – IBGE Workshop on Manufacturing Statistics Kevin Roberts Rio de Janeiro,
Trade and business statistics: use of administrative data Lunch Seminar Enrico Giovannini Italian National Statistical Institute (ISTAT) New York, February,
Linking administrative and survey data - employment variable for enterprises and establishments in Finnish Business Register Jaakko Salmela Statistics.
Eurostat Repeated surveys. Presented by Eva Elvers Statistics Sweden.
Combining administrative and survey data: potential benefits and impact on editing and imputation for a structural business survey UNECE Work Session on.
Electronic reporting in Poland 27th Voorburg Group Meeting Warsaw, Poland October 1st to October 5th, 2012 Central Statistical Office of Poland.
European Conference on Quality in Official Statistics (Q2010) 4-6 May 2010, Helsinki, Finland Brancato G., Carbini R., Murgia M., Simeoni G. Istat, Italian.
1 Business Register: Quality Practices Eddie Salyers
The Canadian Integrated Approach to Economic Surveys Marie Brodeur, Peter Koumanakos, Jean Leduc, Éric Rancourt, Karen Wilson Statistics Canada International.
Rudi Seljak, Metka Zaletel Statistical Office of the Republic of Slovenia TAX DATA AS A MEANS FOR THE ESSENTIAL REDUCTION OF THE SHORT-TERM SURVEYS RESPONSE.
12th Meeting of the Group of Experts on Business Registers
1 Presentation to OG6 Canberra, Australia May 2011 Statistical Uses of Administrative Data in Canada.
Integrating administrative and survey data in the new Italian system for SBS: quality issues O. Luzi, F. Oropallo, A. Puggioni, M. Di Zio, R. Sanzo Nurnberg,
Understanding the Decision to Participate in a Survey and the Choice of the Response Mode Anders Holmberg and Boris Lorenc European Conference on Quality.
The Future of Administrative Data ICES III End Panel Discussion Don Royce Statistics Canada June 2007.
Population Census carried out in Armenia in 2011 as an example of the Generic Statistical Business Process Model Anahit Safyan Member of the State Council.
Impact of using fiscal data on the imputation strategy of the Unified Enterprise Survey of Statistics Canada Ryan Chepita, Yi Li, Jean-Sébastien Provençal,
Eurostat Overall design. Presented by Eva Elvers Statistics Sweden.
Short-Term Economic Statistics Working PartyJune Short Term Economic Statistics Timeliness Framework Richard McKenzie OECD.
A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.
Eurostat Data collection. Presented by Johan Erikson Statistics Sweden.
Statistics Portugal « (Quality Rome, 10 July 2008) « Simplified Business Information: « Improving quality by using administrative data in Portugal.
European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.
The new multiple-source system for Italian Structural Business Statistics based on administrative and survey data Orietta Luzi, Ugo Guarnera, Paolo Righi.
Cristina Casciano, Viviana De Giorgi, Filippo Oropallo Istat Division for Structural Business Statistics, Agriculture, Foreign Trade and Consumer Prices.
Valentina Stoevska ILO Department of Statistics Workshop on MDG Data Reconciliation: Employment Indicators, Beirut, July
Using administrative registers in sample surveys European Conference on Quality in Official Statistics 3-–6 May 2010 Kaja Sõstra Statistics Estonia.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
New sources – administrative registers Genovefa RUŽIĆ.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
United Nations Statistics Division Work Programme on Economic Census Vladimir Markhonko, Chief Trade Statistics Branch, UNSD Youlia Antonova, Senior Statistician,
SNA seminar in the Caribbean Integrated questionnaires Marie Brodeur Director General, Industry Statistics Branch, Statistics Canada St. Lucia February,
The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure Earning Surveys Fabiana Rocci Stefania Cardinleschi.
Integrated Approach Processing Marie Brodeur Director General, Industry Statistics Branch, Statistics Canada St. Lucia February, 2014 SNA seminar in the.
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
STS Compilation with Multiple Data Sources Anu Peltola Economic Statistics Section, UNECE UNECE Workshop on Short-Term Statistics (STS) and Seasonal Adjustment.
Multivariate selective editing via mixture models: first applications to Italian structural business surveys Orietta Luzi, Guarnera U., Silvestri F., Buglielli.
1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway
Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.
CZECH STATISTICAL OFFICE Na padesátém 81, CZ Praha 10, Czech Republic Business Register in the Czech Statistical Office =DISSEMINATION.
Workshop on MDG, Bangkok, Jan.2009 MDG 3.2: Share of women in wage employment in the non-agricultural sector National and global data.
Guidelines on Statistical Business Registers. Draft Chapter 6: Data Sources Andrew Allen UK.
4-6 September 2013, Vilnius Quality in Statistics: Administrative Data and Official Statistics USING ADMINISTRATIVE DATA SOURCES IN OFFICIAL.
Establishing a Statistical Business Register (BR)
Redesigning French structural business statistics, using more administrative data ICESIII, Montréal, june 2007.
Quality Aspects and Approaches in Business Statistics
An Active Collection using Intermediate Estimates to Manage Follow-Up of Non-Response and Measurement Errors Jeannine Claveau, Serge Godbout and Claude.
Prague EU-SILC Best Practice Workshop, 14th and 15th September 2017
Sample surveys versus business register evaluations:
ADMINISTRATIVE DATA IN ANNUAL BUSINESS STATISTICS OF LATVIA
Changed Data Collection Strategies
Organization of efficient Economic Surveys
A new fantastic source for updating the Statistical Business Register
National needs for AES Purpose - describe participation in learning during a 12 months period. The main parameters are; Participation rates in different.
DEVELOPMENT OF IMPUTATION MODEL FOR SMALL ENTERPRISES
in cooperation with the MNE:
Istat - Structural Business Statistics
Sampling and estimation
Reduction of administrative burden through official statistics
Changes in the Canadian Census of Population Program
Task Force on Small and Medium Sized Enterprise Data (SMED)
2.7 Annex 3 – Quality reports
PRODCOM Working Group JMO M November 2012
Presentation transcript:

The converging pattern between Business statistics and Administrative data. Towards an “industrialized” statistical production process The Italian LCS2012 experience Ciro Baldi, Marilena Angela Ciarallo, Stefano De Santis, Silvia Pacini Istat European Conference on Quality in Official Statistics, Schönbrunn Palace Conference Centre, Vienna, Austria, 2-5 June 2014

Contents 1.Some remarks on Labour cost survey 2.New Registers based on new admin sources  administrative data assisted survey 3.Re-design of the LCS 2012: a)An administrative data aware questionnaire b)The contact strategy and the role of the new certified mailing system (PEC) c)Re-thinking of sampling, E&I procedures and estimation European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014

Some information on the LCS 1.The Labour cost survey is a 4 yearly survey enterprise survey designed to collect information on number of employees, hours worked and paid, wages and labur costs 2.Defintions of the LCS regulation are very detailed 3.A quite large number of items and subitems are requested 4.The Enterprise should retrieve the information requested from variuos systems (the presence system for the hours, the payroll system for wages and contributions, accounts data for other labour costs) 5.The Enterprise should perform a number of calculations 6.The survey is one of the most challenging for the enterprises 7.Very low response rates 8.Risks of lot of measurment errors European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014

employees; type of contract; employer;.. Employment Wage Register (EWR) ) Employment Register (ER) ……;wages; other labour costs; paid time;….. Businees Register (BR) Businees Wage Register (BWR) New Register based on new administrative sources Today : Based on Social Security data  Employment Wage Register (EWR) with details on employees, type of contract, wages, a proxy of paid time, other labour costs… Yesterday: Business Register (BR) with information on total number of employees

New administrative sources - Registers Business Wage Register (employees, wages, paid time, other labour costs,…) Business Wage Register (employees, wages, paid time, other labour costs,…) PEC Register Re-design of the LCS 2012 European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Collection and contact strategy Sampling Questionnaire design Estimation E&I An administrative data assisted survey

A bridge European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Although rich the BWR is not sufficient to satisfy the LCS regulation Lacks of detailed subitems of wages and labour costs Core variables do not fit perfectly the regulation definitions Build a questionnaire that is a bridge administrative definitions statistical defiinitions

Design a questionnaire keeping the administrative data in mind  starting from the administrative data definitions Explicit reference to the Social security wage Advantage: separate definitional error from measurement error Add subvoices to adjust for definitions (inclusions/exclusions) Refer to concepts, structures to which the enterprises are accustomed Overall the questionnaire was simplified In future: prefill the questionnaire with main variables from BWR An administrative data aware questionnaire European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014

Sampling European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Use of the data on wages from the BWR (previous year) as parameters in the sample allocation The register data shows higher variability with respect to previous survey, maybe because of self selection of respondents toward higher wages enteprises The allocation among strata is sensibly different from one performed using parameters from sample surveys

Contact strategy: the use of the PEC system European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Since July 2013 the exchange of information and documents between public administrations and enterprises must occur only through Certified (PEC). All enterprises must have a PEC address registered at the Chamber of Commerce Business Register (CCBR). Safe protocols for secure transmission Receipt with date and hour of delivery Same legal value of a post letter sent by recorded delivery and receipt return.

Pec sending system European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 First sending and reminders: more than pec for sampled units Advantages: Costs reduction Preparation time reduced Flexibility: adaptability to survey necessisities Controllability of delivery results The first sending

Pec vs post contact: response rates European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Response rates by mode of first sending

European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Editing & Imputation 1 - Recall of influent enteprises During data collection a recall of influent enterprises was carried out. Identification of recallig units performed with Selemix Identify influent enterprises among outliers detected with mixture models One of the models check number of employees, wages and hours paid against BWR counterparts Allowed to detect categories of errors: Reporting for part of the enterprises Reporting for part of the workforce Gross measurement errors Yearly Employment average mismeasured in case of large turnover Allowed to detect errors in admin data as well Feedback to the people in charge of the register

European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Editing & Imputation 2 Editing of enterprises with significant discrepancies with admin data (in progress) Substitute admin data (benchmark values) Editing plan becomes more complex since: How to choose thresholds for errors Another dimension besides the normal intra survey edits E&I based on admin data comparison should control much better the measurement errors

European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Editing & Imputation 3 and calibration Integration of main variables and pass through variables for total non responses using admin data. Base for subsequent donor imputation for secondary variables Calibration Using employment and wages from BWR as auxiliary variables Highly correlated with target variables  reduce response bias and precision of estimates

European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014 Final remarks E&I and estimation are on going by now. Only provisional remarks: Simplification of the questionnaire, PEC sending and reminders, together with other elements of contact and collection strategy (web questionnaire, telephone contacts etc)  increase of response rate compared to previous editions Editing based on comparison with admin data allow to better control the measurement errors. Sampling and Calibration using admin data on wages should reduce sampling errors In the future: Conducting studies in order to use available variables to minimize the sample size Prefilling the questionnaire with main variables

Thank you for your attention Ciro Baldi European Conference on Quality in Official Statistics, Vienna, 2-5 June 2014