Steps in Scale Development (DeVellis, 2003)

Slides:



Advertisements
Similar presentations
A Systems Approach To Training
Advertisements

Data Collection Strategies An Overview. How Do We Assess ?
Developing a feedback questionnaire: Principles and steps Workshop for NHS staff 28 Dec 1999 (Tuesday) Kam-Por Kwan, EDU
Reliability and Validity of Researcher-Made Surveys.
Research Curriculum Session II –Study Subjects, Variables and Outcome Measures Jim Quinn MD MS Research Director, Division of Emergency Medicine Stanford.
Some (Simplified) Steps for Creating a Personality Questionnaire Generate an item pool Administer the items to a sample of people Assess the uni-dimensionality.
Research Methodology Lecture No : 11 (Goodness Of Measures)
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Measurement Reliability and Validity
SCALE DEVELOPMENT ON CONSUMER BEHAVIOR TOWARD COUNTERFEIT DRUGS IN A DEVELOPING COUNTRY SETTING Alfadl, Abubakr Abdelraouf (1); Ibrahim, Mohamed Izham.
Donald Cooper Pamela Schindler
Evaluating tests and examinations What questions to ask to make sure your assessment is the best that can be produced within your context. Dianne Wall.
Chapter 13 Survey Designs
Measurement Validity and Reliability. Reliability: The degree to which measures are free from random error and therefore yield consistent results.
E 43 Johan Brink, IIE 22 November Quantitative research Lecture
Doing Social Psychology Research
Chapter Three THE RESEARCH PROCESS
Chapter 2 Research Process Part 1: Aug 29, Research Methods Importance of scientific method Research Process – develop ideas, refine ideas, test.
Chapter 13 Survey Designs
Validity and Validation: An introduction Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
Survey Designs EDUC 640- Dr. William M. Bauer
SURVEYS VERSUS INSTRUMENTS
Reliability, Validity, & Scaling
Development of Evaluation Instruments based on ICT Skills Standards for Teachers (ISST) 7th May, 2014.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
Measuring the Unobservable
Questionnaires and Interviews
Experiential Avoidance of Parents Questionnaire (EAP) Melinda Ippolito Morrill, Erin McFadden & James V. Cordova Clark University Melinda Ippolito Morrill,
Quantitative Research 1: Sampling and Surveys Dr N L Reynolds.
CHAPTER 6, INDEXES, SCALES, AND TYPOLOGIES
Marketing Research and the Questionnaire
Convergent and Discriminant Validity. The Convergent Principle Measures of constructs that are related to each other should be strongly correlated.
Identify a Health Problem Qualitative Quantitative Develop Program -theory -objectives -format -content Determine Evaluation -design -sampling -measures.
1 THEORETICAL FRAMEWORK AND RESEARCH METHODOLOGY CHAPTER 3 PREPARED BY: MUKUNDA KUMAR.
VALIDITY AND VALIDATION: AN INTRODUCTION Note: I have included explanatory notes for each slide. To access these, you will probably have to save the file.
8. Observation Jin-Wan Seo, Professor Dept. of Public Administration, University of Incheon.
MEASUREMENT: SCALE DEVELOPMENT Lu Ann Aday, Ph.D. The University of Texas School of Public Health.
1 The Theoretical Framework. A theoretical framework is similar to the frame of the house. Just as the foundation supports a house, a theoretical framework.
Evaluating Survey Items and Scales Bonnie L. Halpern-Felsher, Ph.D. Professor University of California, San Francisco.
The Research Process Step 1-4 IBC464 International College
Validity: Introduction. Reliability and Validity Reliability Low High Validity Low High.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 15 Developing and Testing Self-Report Scales.
The Practice of Social Research Chapter 6 – Indexes, Scales, and Typologies.
© 2006 by The McGraw-Hill Companies, Inc. All rights reserved. 1 Chapter 9 Surveys, Questionnaires, and Polls Most commonly used quantitative method –Used.
 Research Design Part 2 Variability, Validity, Reliability.
Methods of Data Collection Survey Methods Self-Administered Questionnaires Interviews Methods of Observation Non-Participant Observation Participant Observation.
SOCIOLOGICAL RESEARCH Importance of social research Help solve social problems by understanding how they come about, and why they persist. Makes clear.
ACES: Developing a Valid and Reliable Survey to Assess Faculty Support of Diversity Goals.
Realism and Naturalness: A Potential Model for Understanding Physical and Social Presence.
Variables: MEASURING. Starting Phase 2: Research Design.
Research Methodology Lecture No :32 (Revision Chapters 8,9,10,11,SPSS)
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part One INTRODUCTION TO BUSINESS RESEARCH.
McGraw-Hill/Irwin © 2003 The McGraw-Hill Companies, Inc.,All Rights Reserved. Part Four ANALYSIS AND PRESENTATION OF DATA.
Quality instrument* Questions are determined by objectives Resist the temptation to ask questions that are interesting but not relevant to your hypothesis.
The Behavior Assessment System for Children (BASC)
Research Methods for Business Students
QUESTIONNAIRE DESIGN AND VALIDATION
Test Design & Construction
Research strategies & Methods of data collection
Measurement Reliability and Validity
Statistics and Research Desgin
SURVEYS VERSUS INSTRUMENTS
Chapter 2 Research Process
Research strategies & Methods of data collection
Marketing Research: Course 4
TEST CHARACTERISTICS VALIDITY TYPES OF VALIDITY 1- CONTENT VALIDITY
MEASUREMENT AND QUESTIONNAIRE CONSTRUCTION:
Seven Leadership Values inspired by the Beatitudes
Presentation transcript:

Steps in Scale Development (DeVellis, 2003)

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Specificity as an aid to clarity.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct?

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample. 7. Evaluate items.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample. 7. Evaluate items. 8. Produce final scale.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample. 7. Evaluate items. 8. Produce final scale.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample.

6. Administer items to pilot sample.

Administer items to pilot sample. For focus group

Administer items to pilot sample. For focus group Pretest sample should resemble study sample. Sample size 3 to 9 Discuss questions with respondents to find confusion or ambiguity. Refine answer options. Time how long it takes.

Administer items to pilot sample. For pilot study

Administer items to pilot sample. For pilot study Pretest sample should resemble study sample. n>20 Study descriptive statistics of items. Refine answer options. Time how long it takes. Test reliability. Revise scale based on reliability information Examine variance among respondents.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample. 7. Evaluate items. 8. Produce final scale.

Steps in Scale Development (DeVellis, 2003) Determine clearly what it is you want to measure. Theory as an aid to clarity. Measuring “elusive phenomena that cannot be directly observed”. Specificity as an aid to clarity. Do you wish to measure a broad, general construct or a context-specific construct? Locus of control example 2. Generate an item pool. 3. Determine the format for measurement. 4. Have item pool reviewed. 5. Consider inclusion of validation items. 6. Administer items to pilot sample. 7. Evaluate items. 8. Produce final scale.

Locus of control example

Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control

Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control Multidimensional Scale (Levinson, 1973) Generalized, Three dimensions One’s Self Powerful Others Luck or Chance

Locus of control example Internal-External Scale (Rotter, 1966) Generalized, Broad, One dimension Locus of Control Multidimensional Scale (Levinson, 1973) Generalized, Three dimensions One’s Self Powerful Others Luck or Chance Multidimensional Scale (Wallston, Wallston & DeVellis, 1978) Health, Three dimensions One’s Self Powerful Others Luck or Chance Health Health Health