Presentation is loading. Please wait.

Presentation is loading. Please wait.

Errors in Factual Questions and their Consequences Annette Scherpenzeel QMSS Seminar 12-08-2004 Lugano.

Similar presentations


Presentation on theme: "Errors in Factual Questions and their Consequences Annette Scherpenzeel QMSS Seminar 12-08-2004 Lugano."— Presentation transcript:

1 Errors in Factual Questions and their Consequences Annette Scherpenzeel QMSS Seminar 12-08-2004 Lugano

2 Swiss Household Panel Aim Study of social change, in particular, the dynamics of living conditions in the population of Switzerland Method The survey "Living in Switzerland" is carried out among a sample of households representative of the Swiss resident population of 1999. Themes Computer-assisted telephone interviews are conducted with every person older than 14 in the households. Period Both objective data (resources, living conditions, life events, social position, participation, etc.) and subjective data (attitudes, perceptions, satisfaction, values, lifestyles, etc.) are collected Participation Since 1999, five waves have been carried out. The sixth will start in September 2004 Fieldwork In the first wave, 7799 persons in 5074 households have been interviewed. In the fifth wave, 5226 persons in 3296 households have been interviewed. Finance and organization The telephone interviews are conducted every year by the Institute M.I.S. Trend in Lausanne and Bern in German, French and Italian. The household-level interview takes on average 12 minutes, the individual interviews on average 55 minutes.

3 International Standard Classification of Occupations (ISCO) 1.Legislators, senior officials, and managers 2.Professionals 3.Technicians and associate professionals 4.Clerks 5.Service workers and shop and market sales workers 6.Skilled agricultural and fishery workers 7.Craft and related trades workers 8.Plant and machine operators and assemblers 9.Elementary occupations 10.Armed forces

4 ISCO Example 1 [1] Example taken from Bergman and Joye, "Comparing Social Stratification Schemas". Nuclear physicist unit group 2111 (physicists and astronomers) minor group 211 (physicists, chemists and related professions) sub-major group 21 (physical, mathematical and engineering science professionals) group 2 (professionals)

5 Elementary occupations Plant and machine operator assemblers Craft and related trades workers Skilled agricultural and fishery workers Service workers, market sales workers Clerks Technicians and ass- ociate professionals Professionals Legislators, senior officials, managers International Standard Classification of Occupations Distributions of first four waves

6 International Standard Classification of Occupations Change between first and second wave 4 % n = 4993 in 1999, n = 4673 in 2000 Year of panel data collection 20001999 Percentage 100 80 60 40 20 0 12 11 12 13 14 13 2625 1817 7 8 64 % 3 % 1 % 6 % 15 % 4 % Elementary occupations Plant and machine operator assemblers Craft and related trades workers Skilled agricultural and fishery workers Service workers, market sales workers Clerks Technicians and ass- ociate professionals Professionals Legislators, senior officials, managers

7 Variable ALL working persons Persons who have NOT changed job or employer Persons who have changed job or employer %% Type of employment: Self-employed, partner, private, employee 808172 Company: Number of employees (9 response categories) 596324 Percentage of part-time work (recoded into categories) 676840 Type of working hours: fixed, flexible, rotating 575847 Qualifications for job: Not sufficient, correspond, superior, not related 767764 Position: Management, training, production 68 Job tasks: Design, consulting, analysis 51 49 Job with supervisory tasks: Yes, no 767764 Job with participation in decision making: Decision, opinion, no 73 67 International standard classification of occupation (ISCO) 687051 Wright 646649 Goldthorpe 596046 Swiss Socio-Professional Categories (CSP-CH) 707249 Camsis 545633 n* 38283439383 * Total number of working persons with completed individual interviews in both 1999 and 2000. For some variables in the table the n was smaller because of filters to the questions (e.g. "Percentage of part-time work" was only asked to people working part-time).

8 Stability of various other demographic variables Percentage of people with the same score in 1999 and 2000 * Total number of persons with completed individual interviews in both 1999 and 2000. For some variables in the table the n was smaller because of filters to the questions ** Total number of working persons with completed individual interviews in both 1999 and 2000. For some variables in the table the n was smaller because of filters to the questions. VariableAll persons % Highest level of education achieved: 10 categories95 Actual occupation: Paid work, school, family, retired, unemployed, etc., 10 categories 94 Member of which political party: 16 categories90 From work module: Job limitation in time, Yes, no92 Part-time or Full-time92 Private company or government organization91 n10112* / 3828**

9 Four-wave Simplex model of ISCO Category 5 (Service workers, market sales workers) e3 e4 T2 ISCO catg 5 isc25 e2 0.82 T3 ISCO catg 5 isc35 0.82 T4 ISCO catg 5 isc45 0.82 T1 ISCO catg 5 isc15 e1 0.83 0.93 0.94 0.99 d1 d2 d3

10 Four-wave Simplex model using one indicator of hierarchy of work-position. T2 manage p00w34 e2 0.81 T3 manage p01w34 e3 0.79 T4 manage p02w34 e4 0.77 T1 manage p99w34 e1 0.78 0.990.930.99 d1 d2 d3

11 Coefficients estimated with the four-wave Simplex model for all ISCO categories. n in 1999* Reliability coefficient Stability coefficient ISCO (dummy variables)T2T1T3T2T4T3 1 Legislators, senior officials, managers2100.710.880.830.92 2 Professionals4670.850.950.960.99 3 Technicians and assoc. professionals6370.770.970.940.99 4 Clerks3120.810.950.940.97 5 Service workers, market sales workers 2470.820.930.940.99 6 Skilled agriculture and fishery workers710.950.910.98 7 Craft and related trades workers2490.880.96 8 Plant and machine operator assemblers 690.78 - 0.830.890.841 9 Elementary occupations1040.780.820.951 n total**2370 * Frequency distribution of ISCO-1999 for persons having a valid ISCO score in all four waves. ** Total number of persons who have a valid ISCO score in all four waves.

12 General two-wave causal model of satisfaction condition 1 in wave 1 condition 1 in wave 2 condition 2 in wave 1 condition 2 in wave 2 condition 3 in wave 1 condition 3 in wave 2 satisfaction in wave 1 satisfaction in wave 2 relative situation event between waves Stable Component

13 Contribution of the different factors to the explanation of satisfaction DOMAIN relationsworkhealthfinances Percentage of explained variance 80 60 40 20 0 FACTOR Stable component Relative situation Events Living conditions 28 48 11 23 11 24 12 38 41

14 Conclusions Repeated cross-sections give a false impression of stability in "objective" variables. In reality, these variables can contain considerable random variation This unreliability can only be known by repeating the same question in each wave. Because of the nature of the "objective" variables, we can distinguish unreliability from real change The unreliability in the "objective" variables affects their explicative power in longitudinal models. It impairs the opportunities to analyze labor market mobility by panel studies

15 Discussion: What is the cause Swiss Household Survey data collection Not likely: many other variables are stable ISCO coding database SOEP-EG: 20% no change in occupational title but change in occupational class. But: other working variables also unstable? Interviewer: interpretation, training, search strategy, etc Explains only about 2% of the variation over waves Time-interval between measurements: missing events? Selection bias: attrition nor occupational mobility are randomly sampled But: this would select for stability overestimation? Respondent: interpretation, frame of reference, memory, satisfice, etc Question formulation

16 Next: ISCO: Compare with retrospective data from the same respondents ISCO: Compare ISCO occupational title with occupational class Other variables: methodological experiment?


Download ppt "Errors in Factual Questions and their Consequences Annette Scherpenzeel QMSS Seminar 12-08-2004 Lugano."

Similar presentations


Ads by Google