Tests and Measurements: Reliability

Slides:



Advertisements
Similar presentations
Questionnaire Development
Advertisements

Measurement Concepts Operational Definition: is the definition of a variable in terms of the actual procedures used by the researcher to measure and/or.
Ch 5: Measurement Concepts
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect4_1.
Reliability - The extent to which a test or instrument gives consistent measurement - The strength of the relation between observed scores and true scores.
MEQ Analysis. Outline Validity Validity Reliability Reliability Difficulty Index Difficulty Index Power of Discrimination Power of Discrimination.
RELIABILITY & VALIDITY What is Reliability? What is Reliability?What is Reliability?What is Reliability? How Can We Measure Reliability? How Can We Measure.
RELIABILITY & VALIDITY
Concept of Measurement
Measurement Concepts. CONSTRUCT VALIDITY OF MEASURES Indicators of Construct Validity Face validity Aggression questionnaire Not enough to really determine.
Item PersonI1I2I3 A441 B 323 C 232 D 112 Item I1I2I3 A(h)110 B(h)110 C(l)011 D(l)000 Item Variance: Rank ordering of individuals. P*Q for dichotomous items.
Lecture 7 Psyc 300A. Measurement Operational definitions should accurately reflect underlying variables and constructs When scores are influenced by other.
BASIC TERMINOLOGY n Test n Measurement n Evaluation.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
Reliability and Validity what is measured and how well.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Unanswered Questions in Typical Literature Review 1. Thoroughness – How thorough was the literature search? – Did it include a computer search and a hand.
Chapter 4: Test administration. z scores Standard score expressed in terms of standard deviation units which indicates distance raw score is from mean.
Validity and Reliability THESIS. Validity u Construct Validity u Content Validity u Criterion-related Validity u Face Validity.
Chapter Five Measurement Concepts. Terms Reliability True Score Measurement Error.
Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.
Measurement Validity.
Chapter 8 Validity and Reliability. Validity How well can you defend the measure? –Face V –Content V –Criterion-related V –Construct V.
Measurement and Questionnaire Design. Operationalizing From concepts to constructs to variables to measurable variables A measurable variable has been.
Validity Validity: A generic term used to define the degree to which the test measures what it claims to measure.
Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.
Validity and Item Analysis Chapter 4.  Concerns what instrument measures and how well it does so  Not something instrument “has” or “does not have”
Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.
Reliability and Validity in Testing. What is Reliability? Consistency Accuracy There is a value related to reliability that ranges from -1 to 1.
1 Announcement Movie topics up a couple of days –Discuss Chapter 4 on Feb. 4 th –[ch.3 is on central tendency: mean, median, mode]
Validity & Reliability. OBJECTIVES Define validity and reliability Understand the purpose for needing valid and reliable measures Know the most utilized.
RELIABILITY BY DONNA MARGARET. WHAT IS RELIABILITY?  Does this test consistently measure what it’s supposed to measure?  The more similar the scores,
Measuring Research Variables
WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.
Measurement and Scaling Concepts
VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?
ESTABLISHING RELIABILITY AND VALIDITY OF RESEARCH TOOLS Prof. HCL Rawat Principal UCON,BFUHS Faridkot.
Survey Methodology Reliability and Validity
Reliability and Validity
Unit 8: Intelligence (Cognition)
Ch. 5 Measurement Concepts.
Lecture 5 Validity and Reliability
CHAPTER 3: Practical Measurement Concepts
Product Reliability Measuring
Measurement: Part 1.
Reliability & Validity
Associated with quantitative studies
Test Validity.
Journalism 614: Reliability and Validity
Reliability & Validity
Modern Tests of Mental Abilities
Reliability and Validity
Reliability and Validity
پرسشنامه کارگاه.
5. Reliability and Validity
مركز مطالعات و توسعه آموزش دانشگاه علوم پزشكي كرمان
AREA OF STUDY 2: INTELLIGENCE & PERSONALITY
وكالة الكلية للجودة والتطوير
Reliability Internal External Test-retest Inter-rater
RESEARCH METHODS Lecture 18
By ____________________
How can one measure intelligence?
Methodology Week 5.
Measurement Concepts and scale evaluation
A guidance counselor uses a vocational/occupational test to help students determine the type of occupation for which they could be best suited. What would.
Ch 5: Measurement Concepts
Psychological Testing
First Hour - How can one measure intelligence?
Reliability and validity
Presentation transcript:

Tests and Measurements: Reliability Definition: Consistency of scores Test - Retest Reliability Across time Can you repeat the test and get the same results? Alternate forms can be used to reduce the chances of becoming test-wise Internal Reliability Split-half Can you split the test items and each half give you the same results?

Tests and Measurements: Validity Definition: The ability of a test to measure what it was designed to test Face validity Does it look like it measures what it is suppose to measure? Content validity Do the test items represent the trait in question? Criterion validity Does the difference in scores indicate real differences in behavior? Concurrent validity Predictive validity Construct validity Does the construction of the test reflect the theory on which it is based?