Indices and Scales To construct composite measures of variables, we need indices and scales Social science studies deal with many composite measures Many.

Slides:



Advertisements
Similar presentations
Scales and Indices Scales and Indices combine several categories in a question or several questions into a “composite measure” that represents a larger.
Advertisements

Conceptualization and Measurement
Index and Scales Review – What is a concept? What are indicators?
The Research Consumer Evaluates Measurement Reliability and Validity
VALIDITY vs. RELIABILITY by: Ivan Prasetya. Because of measuring the social phenomena is not easy like measuring the physical symptom and because there.
Quiz Do random errors accumulate? Name 2 ways to minimize the effect of random error in your data set.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Indexes, Scales and Typologies. Content validity Achieved by including all the dimensions of a concept Most non-demographic variables require more than.
RESEARCH METHODS Lecture 30. DATA TRANSFORMATION.
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Regression of American pride on socio-demographic factors (Model 1) and attitudes on immigration(Model 2). Model 1Model 2 VariableCoefficient Age 0.25***
Measurement  The process whereby individual instances within a defined population are scored on an attribute according to rules Usually given a numeric.
UGA Libraries Compensation Satisfaction Consulting Project Carrie McCleese Starr Daniell.
1 Single Indicator & Composite Measures UAPP 702: Research Design for Urban & Public Policy Based on notes by Steven W. Peuquet. Ph.D.
RESEARCH METHODS Lecture 18
Measurement in Survey Research Developing Questionnaire Items with Respect to Content and Analysis.
1 Measurement PROCESS AND PRODUCT. 2 MEASUREMENT The assignment of numerals to phenomena according to rules.
Index and Scale Similarities: Both are ordinal measures of variables. Both rank order units of analysis in terms of specific variables. Both are measurements.
1 Measurement Measurement Rules. 2 Measurement Components CONCEPTUALIZATION CONCEPTUALIZATION NOMINAL DEFINITION NOMINAL DEFINITION OPERATIONAL DEFINITION.
Chapter 6 Indexes, Scales, and Typologies. Index and Scale  Index  Constructed by accumulating scores assigned to individual attributes.  Scale  Constructed.
Multiple Regression – Basic Relationships
Chapter 7 Evaluating What a Test Really Measures
FINAL REPORT: OUTLINE & OVERVIEW OF SURVEY ERRORS
Test Validity S-005. Validity of measurement Reliability refers to consistency –Are we getting something stable over time? –Internally consistent? Validity.
Measuring Social Life Ch. 5, pp
Indexes, Scales, and Typologies
Measurement and Data Quality
Scales and Indices While trying to capture the complexity of a phenomenon We try to seek multiple indicators, regardless of the methodology we use: Qualitative.
Measurement and Scaling
Copyright © 2008 by Nelson, a division of Thomson Canada Limited Chapter 11 Part 3 Measurement Concepts MEASUREMENT.
Chapter 3: The meaning of citizenship
CHAPTER 6, INDEXES, SCALES, AND TYPOLOGIES
Sources of Organizational Commitment Yang, Song, Steven Worden, and George Wilson 2004 Sociological Spectrum 24:
Advanced Research Methods Indices, Scales and Typologies By David Warren Kirsch.
Measuring Family Emotional Commitment For each statement below choose the number that best describes your agreement. After you have completed and scored.
Validity In our last class, we began to discuss some of the ways in which we can assess the quality of our measurements. We discussed the concept of reliability.
Measurement Validity.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
MOI UNIVERSITY SCHOOL OF BUSINESS AND ECONOMICS CONCEPT MEASUREMENT, SCALING, VALIDITY AND RELIABILITY BY MUGAMBI G.K. M’NCHEBERE EMBA NAIROBI RESEARCH.
FCS681 Research Questionnaire
The Practice of Social Research Chapter 6 – Indexes, Scales, and Typologies.
Measurement Theory in Marketing Research. Measurement What is measurement?  Assignment of numerals to objects to represent quantities of attributes Don’t.
Chapter 6 Indexes, Scales, And Typologies Key Terms.
Scales and Indices While trying to capture the complexity of a phenomenon We try to seek multiple indicators, regardless of the methodology we use: Qualitative.
PS 366. Levels of Measurement How we classify / observe things Affects how they are described Affects what statistics we use to test hypotheses about.
1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]
6 Indexes, Scales, and Typologies Indexes Vs. Scales ◦ indexes are different than scales ◦ both are composite measures ◦ indexes are simply summed ◦ scales.
Items & Scales. Overarching Theme: Write Understandable Items that Can Be Answered Easily.
Chapter 6 Indexes, Scales, And Typologies. Chapter Outline Indexes versus Scales Index Construction Scale Construction.
STRUCTURED INTERVIEWS AND INSTRUMENT DESIGN PART II Lecture 8.
Class 10 Research Design Lab Time for Term Project Class 11 Remaining Research Design Introduce paper that uses multiple regression Note: T erm project.
Indexes and Scales Why use a “composite” measure of a concept? ▫ There is often no clear “single” indicator ▫ Increase the range of variation ▫ Make data.
Multivariate Analysis - Introduction. What is Multivariate Analysis? The expression multivariate analysis is used to describe analyses of data that have.
Composite Measures Indexes Scales Typologies.
Ch. 5 Measurement Concepts.
Indexes, Scales, and Typologies
CHAPTER 6, INDEXES, SCALES, AND TYPOLOGIES
MEASUREMENT: RELIABILITY AND VALIDITY
Test Validity.
Lecture 6 Structured Interviews and Instrument Design Part II:
5. Reliability and Validity
Chapter 6 Indexes, Scales, And Typologies
RESEARCH METHODS Lecture 18
Indexes, Scales, and Typologies
INDEXES, SCALES, & TYPOLOGIES
RESEARCH METHODS Lecture 30
Chapter 6 Indexes, Scales, and Typologies
Indexes and Scales Why use a “composite” measure of a concept?
Multivariate Analysis - Introduction
Presentation transcript:

Indices and Scales To construct composite measures of variables, we need indices and scales Social science studies deal with many composite measures Many times, social researchers devise many questionnaire items to capture a single social concepts such as religiosity, alienation, etc Indices and scales are efficient data reduction techniques

Indexes versus Scales Indices and scales are ordinal measure of variables. A person’s score on either a score or an index gives an indication of his her relative religiosity Indexes and scales are composite measures of variables, measurements based on more than one data item. A person’s IQ is based on answers to a large number of test questions

Indexes and Scales are Different To construct an index of political activism, we ask respondents to answer the following questions and code them as yes = 1; no = 0 Do you write a letter to a public official? Do you sign a political petition? Do you give money to a political cause? Do you give money to a political candidate? Do you write a political letter to the editor? Do you persuade someone to change her or his voting plans?

Scales To measure political activism, we ask respondents to report Do you vote (yes=1, no =0)? Do you contribute money to a political campaign (yes = 2; no = 0)? Do you work on a political campaign (yes = 3, no =0)? Do you ran for office (yes = 4; no = 0)? However researchers often use indices rather than scales for the variable constructions

Index Construction Index construction includes the following steps Selecting items Examining empirical relations Scoring the index, and Validating the index

Item Selection 1) Face validity To measure religiosity, you ask respondents how much she believes in bible, how often she goes to church, and how often she prays 2) Unidimensionality A composite measure should represent only one dimension of a concept. Items measuring job satisfaction should not be included in a measure of organizational commitment

Item Selection 2 3) General or specific Religious commitment has three dimensions, each has a different set of indicators: commitment to pastors, commitment to church, and commitment to belief. 4) variance You need to distinguish people in your variable construction. What is the problem if you measure people’s tolerance of nuclear technique by asking “do you favor construction of a nuclear station very close to your backyard?”

Examination of Empirical Relationships Examining the empirical relationships among the items in the construction is the second step Bivariate relationship is a relationship between two variables Two indicators to measure U.S. participation in the United Nations. “Do you feel the U.S. financial support of the UN us (1), too high; (2) about right; or (3) too low? Should the United States contribute military personnel to UN peacekeeping actions (1) strongly approve; (2) mostly approve; (3) mostly disapprove; and (4) strongly disapprove

Three Org Commitment Questions The GSS 1991asked three org commitment questions (strong agree =1; agree = 2; disagree = 3; strongly disagree = 4) 1) I am proud to be working for this organization I would take almost any job to keep working for this organization I would turn down another job for more pay in order to stay with this organization

Bivariate Correlation

Multivariate Relationships Multivariate relationships involve more than two questionnaire items

Index Scoring Index scoring is to assign score to different items. In design of index items, you need to deal with two conflicting goals, a broad range of measurement, and an adequate number of cases in each responses To measure people’s tolerance of nuclear technology, you have a very broad range items from “Constructing nuclear power station close to your backyard” to “absolutely no nuclear based station should be constructed anywhere in the world”

Index Scoring 2 Unless you can justify use of different weight, each item carries the same weight The 1996 GSS asked respondents to report 1) Last time, I felt angry that involved workplace 2) Last time I felt angry involving family members 3) Last time, I felt angry involving government Yes = 1; no =0 applies to every question

Handling Missing Data Reasonable guess: a person filled in every “yes” box and left every “no” box blank A person answering “do not know” to “Jehovah witness religion” is actually a “disbeliever” Assigning mean/median to every missing cases, will may produce biased estimates in regression coefficients

Index Validation Validating an index means to measure whether that index capture what it intends to measure. For example, whether the index for political conservatism really measure people’s political view towards conservatism. The following are several ways of measuring index validity

Item Analysis Item analysis/internal validation examines the extent to which the index is related to the individual items it comprises. Index of organizational commitment

Index of Org Commitment Index

External Validation Those score high on one org commitment item should score high on the other two org commitment items too. An external validation indicates the degree to which such a consistency accomplishes.

Bad Index and Bad Validators When an index fails to pass the validation test, it could be either 1) the index does not adequately measure the variables in questions, or 2) the validation items do not adequately measure the variable and do not provide a sufficient test of the index