1 1 Using administrative registers to evaluate the effects of proxy interviews in the Norwegian Labour Force Survey Øyvin Kleven, Ib Thomsen and Ole Villund.

Slides:



Advertisements
Similar presentations
1 Measuring data quality by the use of a routine re-interview module Experiences from the Norwegian European Social Survey Øyvin Kleven and Frode Berglund.
Advertisements

Mean, Proportion, CLT Bootstrap
Conference on Irish Economic Policy Union membership and the union wage Premium in Ireland Frank Walsh School of Economics University College Dublin
Statistics for Managers Using Microsoft® Excel 5th Edition
GATHERING DATA Chapter Experiment or Observe?
* Students will be able to identify populations and samples. * Students will be able to analyze surveys to see if there is bias. * Students will be able.
1 1 Effects of attrition in the Norwegian Survey on statistics on income and living conditions Marit Wilhelmsen Statistics Norway Q European Conference.
Topic 6: Introduction to Hypothesis Testing
The incidence of Mandated Maternity Benefits
Aaker, Kumar, Day Ninth Edition Instructor’s Presentation Slides
© 2013 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Introductory Statistics: Exploring the World through.
The Excel NORMDIST Function Computes the cumulative probability to the value X Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc
United Nations Workshop on Revision 3 of Principles and recommendations for Population and Housing Censuses and Census Evaluation Amman, Jordan, 19 – 23.
Section 5.1. Observational Study vs. Experiment  In an observational study, we observe individuals and measure variables of interest but do not attempt.
7-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 7 Sampling and Sampling Distributions Statistics for Managers using Microsoft.
Q USE OF PROCESS DATA TO DETERMINE THE NUMBER OF CALL ATTEMPTS IN A TELEPHONE SURVEY Annica Isaksson Linköping University, Sweden Peter Lundquist.
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
How sensitive are estimates of the marginal propensity to consume to measurement error in survey data in South Africa Reza C. Daniels UCT
Migration Statistics in Spain SPAIN 1 Migration Statistics in Spain Recent developments Antonio ARGÜESO Socio-Demographic Statistics Director INE-Spain.
Sample Design.
Customer : contractor : December, 2012 Sociologic Research on Awareness of Industrial Property Protection Possibilities.
BPS - 5th Ed. Chapter 81 Producing Data: Sampling.
Producing Data: Sampling BPS - 5th Ed.Chapter 81.
CHAPTER 8 Producing Data: Sampling BPS - 5TH ED.CHAPTER 8 1.
Rudi Seljak, Metka Zaletel Statistical Office of the Republic of Slovenia TAX DATA AS A MEANS FOR THE ESSENTIAL REDUCTION OF THE SHORT-TERM SURVEYS RESPONSE.
Use of survey (LFS) to evaluate the quality of census final data Expert Group Meeting on Censuses Using Registers Geneva, May 2012 Jari Nieminen.
1 CSI5388: Functional Elements of Statistics for Machine Learning Part I.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT OSMAN BIN SAIF Session 19.
Record matching for census purposes in the Netherlands Eric Schulte Nordholt Senior researcher and project leader of the Census Statistics Netherlands.
Emerging methodologies for the census in the UNECE region Paolo Valente United Nations Economic Commission for Europe Statistical Division International.
Copyright ©2011 Pearson Education 7-1 Chapter 7 Sampling and Sampling Distributions Statistics for Managers using Microsoft Excel 6 th Global Edition.
Aim: What is a sample design? Chapter 3.2 Sampling Design.
Section 5.1 Designing Samples Malboeuf AP Statistics, Section 5.1, Part 1 3 Observational vs. Experiment An observational study observes individuals.
ISTAT - Italian National Institute of Statistics Labour Force Survey Division Unit “Methods for LFS data treatment” European Conference on Quality in Official.
Brown, Suter, and Churchill Basic Marketing Research (8 th Edition) © 2014 CENGAGE Learning Basic Marketing Research Customer Insights and Managerial Action.
Introduction Since 1995, the Municipality of Firenze designed a quarterly labour force (LF) survey, parallel to that of ISTAT, to cope with the unavailability,
Approximate letter grade assignments ~ D C B 85 & up A.
Using administrative registers in sample surveys European Conference on Quality in Official Statistics 3-–6 May 2010 Kaja Sõstra Statistics Estonia.
BPS - 5th Ed. Chapter 81 Producing Data: Sampling.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 7-1 Chapter 7 Sampling Distributions Basic Business Statistics.
Dependent interviewing on ONS household surveys Rob Bumpstead Office For National Statistics.
ICCS 2009 IDB Workshop, 18 th February 2010, Madrid 1 Training Workshop on the ICCS 2009 database Weighting and Variance Estimation picture.
Panel discussion: Q2a A.S. Young ILO Bureau of Statistics.
Statistics and Quantitative Analysis U4320 Segment 5: Sampling and inference Prof. Sharyn O’Halloran.
12.2 Inference for a Population Proportion We are interested in the unknown proportion p of a population that has some outcome – call the outcome we are.
Testing Differences between Means, continued Statistics for Political Science Levin and Fox Chapter Seven.
Improving of Household Sample Surveys Data Quality on Base of Statistical Matching Approaches Ganna Tereshchenko Institute for Demography and Social Research,
1 1 Registers as a source for labour market data in the Norwegian National Accounts Ann Lisbet Brathaug
Workshop LFS, April Estimating the non-response bias using exogenous data on employment Etienne Debauche Corinne Prost.
Could that be true? Methodological issues when deriving educational attainment from different administrative datasources and surveys Bart F.M. Bakker Manager.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Sampling and Sampling Distributions Basic Business Statistics 11 th Edition.
1 Statistical business registers as a prerequisite for integrated economic statistics. By Olav Ljones Deputy Director General Statistics Norway
15-April-10 Johan van der Valk Sub sample of persons in Labour Force household Survey Just an idea.
© Statistisches Bundesamt, VI A Statistisches Bundesamt The new method of the next german Population census Johann Szenzenstein, Federal Statistical Office,
Basic Business Statistics
Labour force surveys for measuring employment in the informal sector and informal employment Ralf Hussmanns Head, Methodology and Analysis Unit Bureau.
1 Data Collection and Sampling ST Methods of Collecting Data The reliability and accuracy of the data affect the validity of the results of a statistical.
Status for AP Congrats! We are done with Part I of the Topic Outline for AP Statistics! (20%-30%) of the AP Test can be expected to cover topics from chapter.
Hypothesis Testing. Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean μ = 120 and variance σ.
1 Chapter 11 Understanding Randomness. 2 Why Random? What is it about chance outcomes being random that makes random selection seem fair? Two things:
Review Law of averages, expected value and standard error, normal approximation, surveys and sampling.
Small area estimation combining information from several sources Jae-Kwang Kim, Iowa State University Seo-Young Kim, Statistical Research Institute July.
SECTION 1 TEST OF A SINGLE PROPORTION
Tom.h.wilson Department of Geology and Geography West Virginia University Morgantown, WV.
Tom.h.wilson Department of Geology and Geography West Virginia University Morgantown, WV.
Looking for statistical twins
Sampling: Final and Initial Sample Size Determination
Geology Geomath Chapter 7 - Statistics tom.h.wilson
Chapter 12: Other nonresponse correction techniques
The incidence of Mandated Maternity Benefits
Presentation transcript:

1 1 Using administrative registers to evaluate the effects of proxy interviews in the Norwegian Labour Force Survey Øyvin Kleven, Ib Thomsen and Ole Villund Statistics Norway IAOS Conference on Reshaping Official Statistics, Shanghai, China, October 2008.

What do we mean by proxy? By proxy we mean that another person gives an answer on behalf of the person selected. In Statistics Norway proxy has a long history in the Labour Force Survey (LFS), and has for many years constituted about ten to fifteen percent of the total net sample. The LFS has a relatively short fieldwork period (10 days). Since it is not possible to reach all the respondents in ten days, we allow the interviewers to make proxy interviews. The Norwegian LFS is a sample of families so proxy is easy and cost efficient.

Why proxy? Gives information on respondents that otherwise would have been nonrespondents. The cost efficient argument. Asking someone in the family about the respondent is more efficient than tracing respondents that are hard to get in contact with. If proxy were banned, Statistics Norway would probably have to spend considerably more money to reach about the same response rate that we do to day.

Proxy can introduce more errors: Table 1. Outcome on introducing proxy on nonresponse error and incorrect answers Nonresponse error IncreasingAbout the sameDecreasing Increasing Incorrect answers About the same Decreasing

Non response error and measurement error We need to separate between: –A proxy effect which is due to the fact that proxy is used, and –A selection effect which is due to the fact that the proxy sample is probably not a random sample We are not able to calculate the raw measurement errors, but we use the difference between direct and proxy interviewing as an estimate for the quality of the survey

Using administrative register to evaluate the effects of proxy The Norwegian Employment Register (NER) is a system developed by Statistics Norway. NER is combining –The Central Population Register, –The Register of Employees, –The Register of Wage Sums, –The Tax Return Register, –The Register unemployment and –the Business Register.

Using administrative register to evaluate the effects of proxy The Labour Force Survey has a sample of 24,000 persons, sampled from the population register. The sample consist of families, every person 16 – 74 is included The respondent's spouse/cohabitant or parents are allowed to give information by proxy report. The sample units from LFS is matched on micro level with the NER

Using administrative register to evaluate the effects of proxy We believe it is inappropriate to treat the Employment register as the gold standard or the true value. In direct interviews, the LFS is considered to bee the truth, and therefore we propose that the relationship between the two sources obtained from the direct interviews should be used as the gold standard to measure the effect of proxy interviewing. Therefore we use the term proxy effect rather than “measurement error”.

A. The LFS net sample by employment status in the employment register and the LFS. Register LFS Employed Not employed Employed13,2051,80215,007 Not employed 7235,8356,558 13,9287,63721,565

We calculate the employment rate for direct interview to 13,462/18,764 = 0.717, Table B, and the corresponding employment rate for proxy interview to 1,545/2,801 = from table C. If the proxy sample is random sample from the whole sample this difference may be noted the proxy effect. Under this assumption the proxy effect is However we can se from the tables that this assumption is not feasible B. The direct observed sample by employment given by employment status in the employment register and the LFS Register LFS Employed Not employed Employed 11,9181,54413,462 Not employed 5724,7305,302 12,4906,27418,764 C. The Proxy sample by employment given by employment status in the employment register and the LFS Register LFS Employed Not employed Employed 1, ,545 Not employed 1511,1051,256 1,4381,3632,801

Proxy effect. Under the assumption that the proxy sample is random given the register status, we can estimate the proxy effect within each register status as Employed in register: Proxy effect = Not employed in register: Proxy effect = From this we find that both proxy effects are around -6% and clearly different from the one estimated above. Table D Employment rates by register employment status and proxy/direct interviewing. Register Employed Not employed Direct int. 11,918/12,490= ,544/6,274= Proxy 1,287/1,438= ,58/1,363= Selection effect. Under the same assumption as for the proxy effect, we can estimate the employment rate if direct interviewing was used on the whole sample as (13,928/21,565) * (7,637/21,565)*0.246=0.703 If only the direct sample was used, the employment rate would be 13,462/18,764=0.717 The difference between these two estimates, we denote the selection effect.

Conclusions Direct and full sample (poststratified) Employment rate 70,3 Only direct sample Employment rate 71,7 Observed + proxy sample Employment rate 69,6

Trends

Thank you for your attention