Presentation is loading. Please wait.

Presentation is loading. Please wait.

Multiple Imputation Approaches for Right-Censored Wages in the German IAB Employment Register European Conference on Quality in Official Statistics 2008,

Similar presentations


Presentation on theme: "Multiple Imputation Approaches for Right-Censored Wages in the German IAB Employment Register European Conference on Quality in Official Statistics 2008,"— Presentation transcript:

1 Multiple Imputation Approaches for Right-Censored Wages in the German IAB Employment Register European Conference on Quality in Official Statistics 2008, 10 July 2008 Thomas Büttner Institute for Employment Research (IAB) Susanne Rässler University of Bamberg

2 2 1. Motivation 2. Imputing Censored Wages 3. A Multiple Imputation Approach Considering Heteroscedasticity 4. Simulation Study 5. Results Overview

3 3  For a large number of research questions it is interesting to use wage data - Analyzing the gender wage gap - Measuring overeducation - …  To address this kind of questions two types of data often are used: - Survey data - Administrative data from the social security  Advantages of administrative data - Large number of observations - No response burden - No interviewer bias Motivation

4 4  Administrative data  Represents 80 percent of the employees in Germany  2 percent random sample of all employees covered by social security  1.3 million persons  Problem: Wages can only be recorded up to the contribution limit of the social security system The wage information is censored at this limit The German IAB Employment Sample (1)  Sample drawn from the IAB register data (employment history) supplemented by information on benefit recipients

5 5 The German IAB Employment Sample (2) Daily wages in logs in Western Germany (2000) Source: IAB Employment Sample

6 6  Several possibilities to deal with censored wages  Advantage of multiple imputation: The imputed data set can be used for a multiplicity of questions and analyses  e.g. average wages of certain groups, Analyzing regional wage dispersions, effects of a modification of the contribution limit…  The conventional approaches assume homoscedasticity of the residuals Censored Wages Since in general the dispersion of income is smaller in lower wage categories than in higher categories, the assumption of homoscedasticity is highly questionable with wage data

7 7 Our Project  Step 1: Developing approaches considering heteroscedasticity  Step 2: Simulation study to confirm the necessity and validity of the new approaches  Step 3: Using uncensored wage information from an income survey (German Structure of Earnings Survey, GSES) to validate the approaches  Step 4: Using external wage information for the imputation model

8 8 Imputation Models  Single Imputation based on a homoscedastic tobit model  Single Imputation using a heteroscedastic model  Multiple Imputation based on a homoscedastic tobit model  Multiple Imputation considering heteroscedasticity

9 9  Single imputation based on a homoscedastic tobit model if where a is the contribution limit  Imputation by draws of random values according to the parameters estimated using a tobit model  As the true values are above the contribution limit, draws from a truncated normal distribution Single Imputation

10 10  Development of an imputation approach considering heteroscedasticity (single imputation) based on a GLS model for truncated variables  Imputation by draws from a truncated normal distribution using individual variances Single imputation may lead to biased variance estimations (Little/Rubin 1987) Single Imputation Considering Heteroscedasticity

11 11 Multiple Imputation (1) 1 Impute the data set m times 2 Analyze each data set 3 Combine the results

12 12 Multiple Imputation (2) 1. To be able to start the imputation based on MCMC, we first need to adapt starting values for the parameters from a ML tobit estimation 2. In the imputation step, we randomly draw values for the missing wages from a truncated distribution 3. Based on the imputed data set, we compute an OLS regression 4. After this, we produce random draws for the parameters according to their complete data posterior distribution 5. We repeat the imputation and the posterior-step 5,000 times and use to obtain 5 complete data sets

13 13 Imputation Model Considering Heteroscedasticity (1) Based on the multiple imputation approach with additional draws for describing the functional form of the heteroscedasticity 1. We now start the imputation by adapting starting values from a GLS estimation 2. Then we are able to draw values for the missing wages from a truncated distribution using individual variances 3. Then a GLS regression is computed based on the imputed data set

14 14 Imputation Model Considering Heteroscedasticity (2) 4.Afterwards we perform random draws for and 5.Now the parameter can be drawn randomly according to their complete data posterior distribution 6. The steps 2 to 5 are repeated again 5,000 times and we use to obtain 5 complete data sets

15 15  IAB Employment Sample 2000 (30 June 2000)  Only male persons from Western Germany  Only full time workers covered by social security Simulation Study About 210,000 Persons, about 23,000 or 11 percent with an income above the contribution limit

16 16 Creating Complete Data Sets  As the IAB Employment Sample is censored, we first have to create complete data sets  We create two different data sets:  one data set using an approach presuming homoscedasticity  another data set using an approach considering heteroscedasticity of the residuals

17 17. 1. IABS with censored wages 2. Creating complete data sets (with and without heteroscedasticity), calculating β 3. Defining a new limit 4. Drawing a random sample of 10 percent 5. Imputing the wage using the different approaches, computing a regression Simulation Study 6. Calculating the fraction of confidence intervals of containing the true parameter β for the different approaches

18 18 Results of the Homoscedastic Data Set HOM complete dataSISI-HetMIMI-Het coverage educ10.10680.10690.9590.10740.9510.10730.950.10740.9580.10730.958 educ20.17910.17900.9650.17920.9530.17900.9520.17920.9650.17900.961 educ30.13050.13100.9540.1317 0.939 0.1330 0.935 0.13180.9550.13300.957 educ40.26210.26230.9630.2624 0.928 0.2654 0.888 0.26240.9570.2653 0.949 educ50.44450.4446 0.948 0.4409 0.868 0.4466 0.759 0.4410 0.944 0.4469 0.922 educ60.50980.50960.9620.5064 0.852 0.5121 0.719 0.50650.9530.5118 0.929 level10.54490.54410.9490.54400.9520.54470.950.5440 0.949 0.54460.95 level20.65170.65120.950.65150.9540.65240.9510.65150.9520.65230.951 level30.89580.8950 0.948 0.89730.950.8958 0.936 0.8976 0.948 0.89590.954 level40.89620.89560.9530.89610.950.8962 0.949 0.89620.9510.89630.951 age0.0498 0.9550.0500 0.943 0.0500 0.93 0.05000.9640.05000.957 sqage-0.0005 0.958-0.0005 0.936 -0.0005 0.922 -0.00050.962-0.00050.96 nation-0.0329-0.03270.962-0.0334 0.948 -0.0334 0.942 -0.03350.953-0.03340.955 cons2.44242.44330.9532.4406 0.945 2.4405 0.932 2.44110.9512.4406 0.949

19 19 Results of the Heteroscedastic Data Set HET complete dataSISI-HetMIMI-Het coverage educ10.11410.11450.9520.1271 0.794 0.1136 0.945 0.1272 0.804 0.11360.955 educ20.19120.19150.9550.2075 0.616 0.1903 0.948 0.2076 0.632 0.19030.955 educ30.14420.14440.9610.0947 0.745 0.1406 0.942 0.0952 0.769 0.14200.963 educ40.26850.26860.9610.2753 0.913 0.2688 0.922 0.2754 0.937 0.26890.96 educ50.44330.44350.9630.4790 0.366 0.4372 0.761 0.4796 0.478 0.4377 0.917 educ60.52410.52480.9540.5117 0.785 0.5164 0.718 0.5121 0.869 0.5161 0.896 level10.54220.54260.9550.5415 0.946 0.5422 0.947 0.5416 0.946 0.54170.953 level20.64050.64110.950.6430 0.944 0.6412 0.944 0.6430 0.947 0.64070.95 level30.88560.8864 0.945 0.8780 0.941 0.8845 0.945 0.8782 0.948 0.88380.952 level40.89030.89080.9520.8737 0.941 0.8919 0.943 0.8737 0.941 0.89130.951 age0.04320.04310.9550.0457 0.645 0.0431 0.948 0.0457 0.679 0.04310.97 sqage-0.0004 0.96-0.0005 0.59 -0.0004 0.941 -0.0005 0.623 -0.00040.968 nation-0.0223-0.02180.961-0.0297 0.872 -0.0222 0.945 -0.0296 0.882 -0.02220.954 cons2.58582.5865 0.947 2.5318 0.909 2.5868 0.945 2.5315 0.914 2.58750.952

20 20 Simulation study using external wage information (1)  Scientific-Use-File of the German Structure of Earnings Survey (GSES) 2001  Linked Employer-Employee data set  Information on about 22.000 establishments and about 846.000 employees  Information on - individuals (e.g. sex, age, education) - jobs (e.g. occupation, job level, working times) - income (e.g. gross wage, net wage, income taxes) - and establishments

21 21 Simulation study using external wage information (2)  Selection of a sample comparable to the first simulation study  Complete data set containing 382.710 persons  Censoring at the 85 percent quantile

22 22 Simulation study using external wage information (3)

23 23 Outlook  Using uncensored information from survey data for the imputation model  Inference under uncongeniality  Validation of our approach by reproducing different studies using imputed data

24 24 References Bender, S., Haas, A. and Klose, C. (2000). IAB Employment Subsample 1975-1995. Opportunities for Analysis Provided by Anonymised Subsample. IZA Discussion Paper117, IZA Bonn. Buchinsky, M. (1994). Changes in the U.S. wage structure 1963–1987: Application of quantile regression. Econometrica 62(2), 405–458. Gartner, H. (2005). The imputation of wages above the contribution limit with the German IAB employment sample. FDZ Methodenreport 2/2005. Gartner, H. and Rässler, S. (2005). Analyzing the changing gender wage gap based on multiply imputed right censored wages. IAB Discussion Paper 05/2005. Jensen, U., Gartner, H. and Rässler, S. (2006). Measuring overeducation with earnings frontiers and multiply imputed censored income data. IAB Discussion Paper Nr. 11/2006. Khan, S. and Powell, J.L. (2001). Two-step estimation of semiparametric censored regression models. Journal of Econometrics 103, 73–110. Little, R.J.A and Rubin D.R. (1987). Statistical Analysis with Missing Data. John Wiley, New York, 1 edn. Meng, X.L. (1994). Multiple Imputation Inferences with Uncongenial Sources of Input. Statistical Sciences Volume 9, 538-558. Powell, J.L. (1986). Symmetrically Trimmed Least Squares Estimation for Tobit Models. Econometrica 54(6),1435-1460. Rässler, S. (2006). Der Einsatz von Missing Data Techniken in der Arbeitsmarktforschung des IAB. Allgemeines Statistisches Archiv. Rubin, D.B. (1987). Multiple Imputation for Nonresponse in Surveys. J.Wiley & Sons, New York. Schafer, J.L. and Yucel, R.M (2002). Computational Strategies for Multivariate Linear Mixed-Effects Models With Missing Values. Journal of Computational and Graphical Statistics Volume 11 437-457. Schafer, J.L. (1997). Analysis of Incomplete Multivariate Data. Chapman & Hall, New York.

25 25 Combining Rules The associated variance estimate has two components. The within-imputation-variance is the average of the complete-data-variance estimates: The between-imputation-variance is the variance of the complete-data point estimates: The total variance is defined as: Multiple Imputation point estimate for is defined as:

26 26 First Results  The simulation study using these three approaches shows the necessity of a new method that multiply imputes the missing wages and does not presume heteroscedasticity  Second step: Development of a new multiple imputation approach considering heteroscedasticity  Finally we perform a new simulation study to compare the four approaches under different situations in order to confirm the necessity as well as the validity of the new approach

27 27 We use a two-step procedure for each of the m draws: 1.We perform random draws of the parameter according to their observed-data posterior distribution 2.We make random draws of Y mis according to their conditional predictive distribution The first step is problematical as the observed data posteriors are often no standard distributions. Therefore we draw from and the desired distributions are achieved as stationary distributions of Markov Chains. Multiple Imputation

28 28 Principle of multiple Imputation (2)  Advantage: Considers the additional uncertainty  Principle: Based on independent random draws from the posterior predictive distribution of the missing data given the observed data  Problem:It may be difficult to draw from  But:

29 29 Simulation Study (2)  The simulation procedure consisting of  drawing a random sample,  deleting the wages above the limit  imputing the data using the different approaches,  computing a regression,  and calculating the confidence intervals is repeated 1000 times.  Coverage: The fraction of confidence intervals of containing the true parameter β for the different approaches

30 30 Summary of Results  In case of a homoscedastic structure of the residuals the same quality of imputation results can be expected from the two multiple imputation approaches  In case of heteroscedasticity the simulation study confirms the necessity of our new approach  Since the structure of the wages in the IAB employment register is heteroscedastic, the results of the simulation study necessitate the use of the new approach to impute the missing wage information in this register


Download ppt "Multiple Imputation Approaches for Right-Censored Wages in the German IAB Employment Register European Conference on Quality in Official Statistics 2008,"

Similar presentations


Ads by Google