Validity and Reliability THESIS. Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity.

Slides:



Advertisements
Similar presentations
Questionnaire Development
Advertisements

1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Types of Reliability.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Validity and Reliability Chapter Eight.
VALIDITY AND RELIABILITY
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
Reliability: Internal Consistency By Lynn Woolever AED 615 October 23, 2006.
Reliability and Validity of Research Instruments
RESEARCH METHODS Lecture 18
Reliability n Consistent n Dependable n Replicable n Stable.
Reliability Analysis. Overview of Reliability What is Reliability? Ways to Measure Reliability Interpreting Test-Retest and Parallel Forms Measuring and.
Reliability and Validity Dr. Roy Cole Department of Geography and Planning GVSU.
Definition & Measurement “measurement is the beginning of science, … until you can measure something, your knowledge is meager and unsatisfactory” Lord.
Reliability n Consistent n Dependable n Replicable n Stable.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
Research Methods in MIS
Educational Assessment
Technical Issues Two concerns Validity Reliability
Measurement and Data Quality
Validity and Reliability
Reliability, Validity, & Scaling
Business Research Method Measurement, Scaling, Reliability, Validity
Test Worthiness Chapter 3.
VALIDITY, RELIABILITY, and TRIANGULATED STRATEGIES
Instrumentation.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Data Analysis. Quantitative data: Reliability & Validity Reliability: the degree of consistency with which it measures the attribute it is supposed to.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 14 Measurement and Data Quality.
SELECTION OF MEASUREMENT INSTRUMENTS Ê Administer a standardized instrument Ë Administer a self developed instrument Ì Record naturally available data.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
LECTURE 06B BEGINS HERE THIS IS WHERE MATERIAL FOR EXAM 3 BEGINS.
Principles of Test Construction
Measurement Validity.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Assessing Measurement Quality in Quantitative Studies.
Reliability: The degree to which a measurement can be successfully repeated.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
McGraw-Hill/Irwin © 2012 The McGraw-Hill Companies, Inc. All rights reserved. Obtaining Valid and Reliable Classroom Evidence Chapter 4:
Reliability n Consistent n Dependable n Replicable n Stable.
MEASUREMENT: PART 1. Overview  Background  Scales of Measurement  Reliability  Validity (next time)
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
Reliability When a Measurement Procedure yields consistent scores when the phenomenon being measured is not changing. Degree to which scores are free of.
Chapter 6 Norm-Referenced Reliability and Validity.
Copyright © 2014 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 11 Measurement and Data Quality.
Chapter 6 Norm-Referenced Measurement. Topics for Discussion Reliability Consistency Repeatability Validity Truthfulness Objectivity Inter-rater reliability.
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Quality instrument* Questions are determined by objectives Resist the temptation to ask questions that are interesting but not relevant to your hypothesis.
Measurement and Scaling Concepts
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Survey Methodology Reliability and Validity
Unit 8: Intelligence (Cognition)
Lecture 5 Validity and Reliability
Measurement: Part 1.
Reliability & Validity
Tests and Measurements: Reliability
Introduction to Measurement
مركز مطالعات و توسعه آموزش دانشگاه علوم پزشكي كرمان
PSY 614 Instructor: Emily Bullock, Ph.D.
RESEARCH METHODS Lecture 18
How can one measure intelligence?
Methodology Week 5.
Measurement Concepts and scale evaluation
Measurement: Part 1.
Chapter 8 VALIDITY AND RELIABILITY
Reliability and validity
Presentation transcript:

Validity and Reliability THESIS

Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity

Construct Validity Is the underlying construct or theoretical foundation of the survey consistent with research and information on the topic?

Content Validity Does the content of the items in the instrument accurately reflect the underlying construct?

Criterion-related Validity Does the instrument contain the proper criteria for measuring the traits or constructs of interest?

Face Validity Does the instrument look like it will measure what it is supposed to measure?

Reliability u Test - Retest u Alternative forms u Split halves u Internal consistency

Test - Retest Method u Administer instrument u Analyze responses u Administer instrument again under exact conditions u Correlate responses

Alternative Forms Method u Administer instrument u Analyze responses u Administer different form of same survey u Correlate responses

Split Halves Method u Administer instrument u Separate responses by odd and even items u Correlate two halves u Correct using Spearman-Brown

Internal Consistency (Cronbach’s Alpha) u Administer instrument u Compute inter-item correlation matrix u Compute mean inter-item correlation u Enter alpha formula

Question Can a survey be: Valid but not reliable? Reliable but not valid?