An assessment of the robustness of weights in the Famille et Employeurs survey Nicolas Razafindratsima & Elisabeth Morand.

Slides:



Advertisements
Similar presentations
MICS 3 DATA ANALYSIS AND REPORT WRITING. Purpose Provide an overview of the MICS3 process in analyzing data Provide an overview of the preparation of.
Advertisements

Innovation data collection: Methodological procedures & basic forms Regional Workshop on Science, Technology and Innovation (STI) Indicators.
Innovation data collection: Advice from the Oslo Manual South East Asian Regional Workshop on Science, Technology and Innovation Statistics.
Innovation Surveys: Advice from the Oslo Manual South Asian Regional Workshop on Science, Technology and Innovation Statistics Kathmandu,
Innovation Surveys: Advice from the Oslo Manual National training workshop Amman, Jordan October 2010.
Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?
Outline of talk The ONS surveys Why should we weight?
30a. Percentage of employees who have a high school diploma or higher education, by industry, 2010 (All employment)
Survey Methodology Nonresponse EPID 626 Lecture 6.
Robin L. Donaldson May 5, 2010 Prospectus Defense Florida State University College of Communication and Information.
The estimation strategy of the National Household Survey (NHS) François Verret, Mike Bankier, Wesley Benjamin & Lisa Hayden Statistics Canada Presentation.
NLSCY – Non-response. Non-response There are various reasons why there is non-response to a survey  Some related to the survey process Timing Poor frame.
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Joint UNECE/Eurostat Meeting on Population and Housing Censuses (13-15 May 2008) Sample results expected accuracy in the Italian Population and Housing.
Joint Canada/U.S. Health Survey Catherine Simile, National Center for Health Statistics Patrice Mathieu, Statistics Canada Ed Rama, Statistics Canada NCHS.
National Household Survey: collection, quality and dissemination Laurent Roy Statistics Canada March 20, 2013 National Household Survey 1.
Household Surveys ACS – CPS - AHS INFO 7470 / ECON 8500 Warren A. Brown University of Georgia February 22,
Survey Methods By Shivakumaraswamy, K N
Effects of Income Imputation on Traditional Poverty Estimates The views expressed here are the authors and do not represent the official positions.
Customer : contractor : December, 2012 Sociologic Research on Awareness of Industrial Property Protection Possibilities.
Innovations on methods and survey process for the 2011 Italian population census European Conference on Quality in Official Statistics 8-11 July, 2008.
Nonresponse issues in ICT surveys Vasja Vehovar, Univerza v Ljubljani, FDV Bled, June 5, 2006.
Multiple Indicator Cluster Surveys Survey Design Workshop Sampling: Overview MICS Survey Design Workshop.
Coverage assessment and adjustment methodology Owen Abbott Methodology Directorate, ONS.
Understanding the Decision to Participate in a Survey and the Choice of the Response Mode Anders Holmberg and Boris Lorenc European Conference on Quality.
Lesli Scott Ashley Bowers Sue Ellen Hansen Robin Tepper Jacob Survey Research Center, University of Michigan Third International Conference on Establishment.
Impact of using fiscal data on the imputation strategy of the Unified Enterprise Survey of Statistics Canada Ryan Chepita, Yi Li, Jean-Sébastien Provençal,
Internet Surveys & Future Works In Official Statistics 1 The 4th International Workshop on Internet Survey Methods, Sept. Statistical Center, Statistics.
Scot Exec Course Nov/Dec 04 Survey design overview Gillian Raab Professor of Applied Statistics Napier University.
European Conference on Quality in Official Statistics Roma, July 8-11, 2008 New Sampling Design of INSEE’s Labour Force Survey Sébastien Hallépée Vincent.
A Strategy for Prioritising Non-response Follow-up to Reduce Costs Without Reducing Output Quality Gareth James Methodology Directorate UK Office for National.
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” European Conference on Quality in Official.
European Conference on Quality in Official Statistics Session 26: Quality Issues in Census « Rome, 10 July 2008 « Quality Assurance and Control Programme.
The new multiple-source system for Italian Structural Business Statistics based on administrative and survey data Orietta Luzi, Ugo Guarnera, Paolo Righi.
Introduction Since 1995, the Municipality of Firenze designed a quarterly labour force (LF) survey, parallel to that of ISTAT, to cope with the unavailability,
Handling Attrition and Non- response in the 1970 British Cohort Study Tarek Mostafa Institute of Education – University of London.
Economics and Statistics Administration U.S. CENSUS BUREAU U.S. Department of Commerce Assessing the “Year of Naturalization” Data in the American Community.
Lecture 9 Prof. Development and Research Lecturer: R. Milyankova
Centraal Bureau voor de Statistiek Challenges of redesigning household surveys and maintaining output quality Menno Cuppen Paul van der Laan Wim van Nunspeet.
Using administrative registers in sample surveys European Conference on Quality in Official Statistics 3-–6 May 2010 Kaja Sõstra Statistics Estonia.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section A 1.
5-4-1 Unit 4: Sampling approaches After completing this unit you should be able to: Outline the purpose of sampling Understand key theoretical.
A discussion of Comparing register and survey wealth data ( F. Johansson and A. Klevmarken) & The Impact of Methodological Decisions around Imputation.
The challenge of a mixed-mode design survey and new IT tools application: the case of the Italian Structure Earning Surveys Fabiana Rocci Stefania Cardinleschi.
Increasing Efficiency in Data Collection Processes Arie Aharon, Israel Central Bureau of Statistics.
Household Surveys: American Community Survey & American Housing Survey Warren A. Brown February 8, 2007.
Improving of Household Sample Surveys Data Quality on Base of Statistical Matching Approaches Ganna Tereshchenko Institute for Demography and Social Research,
1 For a Population Statistical Register Characteristics and Potentials for the Official Statistics Central department for administrative data and archives.
Workshop LFS, April Estimating the non-response bias using exogenous data on employment Etienne Debauche Corinne Prost.
2002 Turkey Disability Survey. Purpose of Disability Survey The aim of this survey is to collect data on  Number of disabled people,  The proportion.
Core variables in Estonian social surveys Merle Paats Statistics Estonia.
Analysis of the characteristics of internet respondents to the 2011 Census to inform 2021 Census questionnaire design Orlaith Fraser & Cal Ghee.
1 Introduction to Statistics. 2 What is Statistics? The gathering, organization, analysis, and presentation of numerical information.
By R. Gambacorta and A. Neri Bank of Italy - Statistical Analysis Directorate Wealth and its returns: economic inequality in Italy, The Bank.
CASE CONTROL STUDY. Learning Objectives Identify the principles of case control design State the advantages and limitations of case control study Calculate.
2007 Census Test – Analysis of Coverage Owen Abbott Methodology Directorate.
Guillaume Osier Institut National de la Statistique et des Etudes Economiques (STATEC) Social Statistics Division Construction.
1 1 Using administrative registers to evaluate the effects of proxy interviews in the Norwegian Labour Force Survey Øyvin Kleven, Ib Thomsen and Ole Villund.
United Nations Regional Workshop on the 2010 World Programme on Population and Housing Censuses: Census Evaluation and Post Enumeration Surveys, Addis.
DEMAND FORECASTING & MARKET SEGMENTATION. Why demand forecasting?  Planning and scheduling production  Acquiring inputs  Making provision for finances.
28a. Percentage of employees having a high school diploma or higher education, by industry, 2005 (All types of employment)
Effect of Panel Length and Following Rules on Cross-Sectional Estimates of Income Distribution: Empirical Evidence from FI-SILC Marjo Pyy-Martikainen Workshop.
Prepared by Yuliia Halytsia
Chapter 8: Weighting adjustment
LAMAS Working Group 6-7 December 2017
Sampling and estimation
The European Statistical Training Programme (ESTP)
Presentation transcript:

An assessment of the robustness of weights in the Famille et Employeurs survey Nicolas Razafindratsima & Elisabeth Morand INED European Conference on Quality in Official Statistics, Rome, July 2008

Outline Introduction The Famille et Employeurs survey Methodology of weights calculations Results Conclusion

Introduction In indirect sampling : the generalized weight share method (Lavallée, 2002 & 2007) is a simple and easy strategy to produce unbiased estimations Objective of this study : to expose the implementation of this method for the Familles et Employeurs survey (Ined/Insee, ) : difficulties, and robustness of the weights obtained.

The Familles et Employeurs survey Main purpose : to study professional and family life conciliation: - from the employees point of view - from the employers point of view Can behaviours within the family be explained through employers rules and characteristics? A matched survey: employee  employers

The household survey Sampling strategy : - a sample of dwellings drawn from the INSEE master sample  of them answered - interview of 1 or 2 individuals, aged 20-49, in each household (random sampling if >2)  respondents Face to face interview. Questionnaire on demographic events (birth, unions), family life organization, etc., in relation to individuals professional context

The establishment survey Target : Establishments of 20 employees or more Individuals respondents were asked to give their employers name, address, national identification number as well as their size and sector. A self administered questionnaire was sent to the establishments. Possibility to answer by paper or by the Internet respondents.

Weighting methodology The basic for establishments weighting methodology : the generalized weight share method Where : Wi=weight of establishment i Wj=weight of individual j (those in the sample) Li= number of eligible employees (aged 20-49) in the establishment i

Weighting methodology Difficulties : - the choice of individuals weight (non-response, calibration) - the estimation of the number of employees aged in the establishment [- establishment non-responses]

Weighting the sample of individuals Non response variations : – At the household level (non-response higher in urban areas, for collective dwellings, etc.) – At the individual level (non-response higher for males, single persons, less-educated people, etc.) Non-response adjustments : – At the household level : using corrective response rates within response homogeneity groups – At the individual level : calibration (on Labor force survey data) - on a single variable : gender*age - or on 7 variables : gender*age, employment status, nationality, region, highest diploma, urbanization status, household size

Distribution of individuals weights Calibration variablesNMeanCV (%)MinMedianMaxMax/ Min Gender*age ,148,0557, ,5 7 variables ,151,9440, ,8

Estimation of the number of eligible employees (aged 20-49) Number of employees (total and by age groups) asked in the establishment questionnaire But number of not available for 16% of the establishments (item non-response) Imputation of number of when non-response : using coefficients of a regression model among respondents, linking nb of to total (one model by activity sector) For 2/3 of the establishments, total size is also available through the SIRENE directory. Allows an other estimation of number for evaluation purposes

Distribution of total size NMeanCV (%)MinMedianMaxMax/ Min Declared ,5264,620,0152, ,8 SIRENE (after imputation) ,6285,020,0151, ,7

Distribution of number of Nb of missi ng MeanCV (%)MinMedianMaxMax/ Min Declared433419,5259,03,0110, ,0 Imputed using declared 0398,0256,53,0109, ,0 Imputed using SIRENE 0430,7286,513,9113, ,0

Summary of the options for establishments weighting Calibration variables for individual weights Estimation of the number of employees aged Imputation using declared size Imputation using SIRENE size Gender*age onlyP1P2 7 variables- P3 - P3tr : trimmed P5 & P95 then adjusted on the total P4 Employees weight=establishment weight*nb of employees

Distribution of establishment weights MeanCV (%)MinMaxMax/ Min Nb of weights < 1 P141,8138,60,3646,02 583,951 P241,1128,70,1476,47 217,455 P341,3140,80,2592,03 235,060 P440,7134,00,1459,98 516,367 P3tr 41, ,7155,291,20

Distribution of employees weight MeanCV (%)MinMaxMax/ Min P14 019,681,6819, ,985,1 P23 835,362,1819, ,643,1 P33 926,081,4586, ,2113,1 P43 751,266,0586, ,263,9 P3tr4 409,082,1980, ,7 77,7

Percentage of establishments having a crèche

Percentage of employees working in an establishment with a crèche

Conclusion Weight sharing method : – A simple and easy to implement method – However, difficult to implement in the Famille et Employeurs survey, due to : non-responses on the ‘link’ variable High dispersion of the size variable More sensitive to the link variable than on specification of the individual weights All the computed weights present great variability Weight trimming may improve precision at the establishment level, but fails to do so at the employees level

References Lavallée, P. (2002) : Le sondage indirect, ou la méthode généralise du partage des poids, Bruxelles, Presses de l’université libre de Bruxelles et Paris, Ellipses, 242 pages. Lavallée, P. (2007) : Indirect sampling, New York, Springer (Springer series in statistics), 245 pages.

Thank you for your attention !