Reliability and validity

Slides:

Advertisements

Similar presentations

Questionnaire Development

Advertisements

Allyn & Bacon 2003 Social Work Research Methods: Qualitative and Quantitative Approaches Topic 7: Basics of Measurement Examine Measurement.

Chapter 8 Flashcards.

Ch 5: Measurement Concepts

What is a Number?. What is a number? Names and symbols are arbitrary.

Chapter Eight & Chapter Nine

Taking Stock Of Measurement. Basics Of Measurement Measurement: Assignment of number to objects or events according to specific rules. Conceptual variables:

MEASUREMENT CONCEPTS © 2012 The McGraw-Hill Companies, Inc.

Part II Sigma Freud & Descriptive Statistics

CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY

Data and the Nature of Measurement

Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.

1 Measurement PROCESS AND PRODUCT. 2 MEASUREMENT The assignment of numerals to phenomena according to rules.

Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.

Manipulation and Measurement of Variables

FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,

Variables cont. Psych 231: Research Methods in Psychology.

Dr. Satyendra Singh, Department of Adminstrative Studies Welcome to the Class of Univariate Data Analysis & Marketing Research Questions.

Scales of Measurement What is a nominal scale? A scale that categorizes items What is an ordinal scale? A scale that categorizes and rank orders items.

Measurement and Data Quality

Business Research Method Measurement, Scaling, Reliability, Validity

Reliability and Validity what is measured and how well.

Instrumentation.

Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.

Measurement Neuman and Robson Ch. 6. What is it? The process of creating measurable concrete variables from abstract concepts Extends the senses (empirical)

1 Psychology 2020 Measurement & Observing Behavior Unit 2.

What is a Measurement? Concept of measurement is intuitively simple  Measure something two concepts involved  The thing you are measuring  The measurement.

Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.

Research methods in clinical psychology: An introduction for students and practitioners Chris Barker, Nancy Pistrang, and Robert Elliott CHAPTER 4 Foundations.

Learning Objective Chapter 9 The Concept of Measurement and Attitude Scales Copyright © 2000 South-Western College Publishing Co. CHAPTER nine The Concept.

Asking Good Questions Chapter 7. Scales of Measurement Nominal Nominal Ordinal Ordinal Interval Interval Ratio Ratio.

1 Measurement and Data Collection  What and How?  Types of Scales Nominal Nominal Ordinal Ordinal Interval Interval Ratio Ratio.

Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.

1 Chapter 10 Attitude Measurement © 2005 Thomson/South-Western.

Reliability: The degree to which a measurement can be successfully repeated.

Introducing Communication Research 2e © 2014 SAGE Publications Chapter Five Measurement: Research Using Numbers.

What is a Number?. What is a number? Names and symbols are arbitrary.

Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.

MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)

Measurement Experiment - effect of IV on DV. Independent Variable (2 or more levels) MANIPULATED a) situational - features in the environment b) task.

Chapter 6 - Standardized Measurement and Assessment

Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.

Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.

Measurement and Scaling Concepts

Ch. 5 Measurement Concepts.

Lecture 5 Validity and Reliability

Experiment Basics: Variables

Product Reliability Measuring

Experiment Basics: Variables

Measurement: Part 1.

Associated with quantitative studies

Test Design & Construction

Social Research Methods MAN-10 Erlan Bakiev, Ph. D.

CHAPTER 5 MEASUREMENT CONCEPTS © 2007 The McGraw-Hill Companies, Inc.

Tests and Measurements: Reliability

Definition & Measurement

Introduction to Measurement

Part Two THE DESIGN OF RESEARCH

Measurement with Numbers Scaling: What is a Number?

Reliability, validity, and scaling

Dr. Chin and Dr. Nettelhorst Winter 2018

Measurement: Part 1.

Chapter 6 Indexes, Scales, And Typologies

Measurement Concepts and scale evaluation

Measurement: Part 1.

Ch 5: Measurement Concepts

Measurement scales.

Review and then observe

Presentation transcript:

Reliability and validity

Reliability vs. validity Consistency True score + measurement error Validity Truth Can a scale be reliable but not valid? Can a scale be valid but not reliable?

Types of reliability Test-retest Alternate forms Internal consistency Split-half Odd-even Cronbach’s alpha (item-total reliability) Inter-rater reliability

Types of validity Face validity Construct validity Convergent Divergent/discriminant Known groups Criterion-related validity Concurrent Predictive

Problems for validity Demand characteristics Social desirability

Other types of validity Internal validity External validity

Types of scaling Nominal (difference) Ordinal (magnitude) Interval (equal intervals) Ratio (true zero)

Why do scale types matter? More properties, more information Affect the statistics you can do Helps you evaluate research

What types of scales are these? 1. October 22, 1850 (year Fechner’s law) 2. number of alarm class by a chickadee in one hour 3. third place in a beauty contest 4. having the fifth highest grades in a class of 29 people 5. being a sophomore in college 6. Thurstone scale 7. Guttman scale 8. Likert scale 9. Semantic differential