Reliability and Validity

Slides:

Advertisements

Similar presentations

The Research Consumer Evaluates Measurement Reliability and Validity

Advertisements

Reliability and Validity of Dependent Measures

Psychological Research and Scientific Method pt3 Designing psychological investigations.

Social Psychology -- Methodology Observation (incl. participant obs.) Archival analysis – type of observational method, the researcher examines the accumulated.

Baron Cohen et al (1997) Reading Minds The eye task.

Week 5.  A psychologist at the local university agrees to carry out a study to investigate the claim that eating a healthy breakfast improves reading.

Psych 231: Research Methods in Psychology

Psychology The usefulness of psychological research.

Variables cont. Psych 231: Research Methods in Psychology.

Validity, Reliability, & Sampling

Reliability and Validity. * How consistent the test is within itself - this might be affected by different people collecting the data differently in an.

Reliability A measure of consistency. Can we get the same results when the same measure is used on another occasion? Measures in research should be reliable.

Realism The aim of any study is to provide information about how people behave in ‘real-life.’ IF the set-up of the study is too artificial then the participants.

Experimental Research

Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.

Methodology Experiments.

Understand how we can test and improve validity of a study The Pros and Cons of different sampling techniques.

Lesson 9: Reliability, Validity and Extraneous Variables.

Student information pack: Validity Some key points which you may find helpful.

All homework assessments to go in your folder in order. With a homework cover sheet Chose a piece of homework to make improvements on. Use a different.

RED YELLOW PINK BLUE BROWN GREEN BLACK PURPLE WHITE ORANGE GOLD BLACK YELLOW BLACK YELLOW PURPLE PINK RED BLACK BLACK BLUE.

Reliability vs. Validity.  Reliability  the consistency of your measurement, or the degree to which an instrument measures the same way each time it.

Revision of key terms Write down the 12 key terms for the definitions on the slides.

Reliability and Validity. Thinking Questions What is an IV? What is a DV? What is repeated measures design? What is matched pairs design? What is independent.

Advanced Research Methods Unit 3 Reliability and Validity.

Experiment Basics: Variables Psych 231: Research Methods in Psychology.

Task Answer the review questions on the next slide on your own paper.

Research Methodology and Methods of Social Inquiry Nov 8, 2011 Assessing Measurement Reliability & Validity.

Reliability and Validity Research Methods. RECAP! OBSERVATIONAL METHODS  Create 3 behavioural categories for the following: - Observation of students.

Reliability and Validity Themes in Psychology. Reliability Reliability of measurement instrument: the extent to which it gives consistent measurements.

Validity The degree to which an assessment, test or operationalised variable measures (a) what is intended, as opposed to (b) what is not intended, or.

Laboratory Experiment ValidityReliability Test-Retest Artificial Mundane Realism Generalise Consistent Informed Consent Demand Characteristics Control.

Dependant + Independent variables Independent = directly manipulated by the experimenter Dependant = the variable affected by the independent variable.

Lesson 4. In a laboratory experiment involving a medical consultation role-play, participants were randomly allocated to one of two conditions. In Condition.

Sampling techniques validity & reliability Lesson 8.

WHS AP Psychology Unit 7: Intelligence (Cognition) Essential Task 7-3:Explain how psychologists design tests, including standardization strategies and.

VALIDITY What is validity? What are the types of validity? How do you assess validity? How do you improve validity?

Designing psychological investigations

Self-Reports (non-experimental)

Quantitative and Qualitative data

Lesson 4 Cognitive Psychology.

Experiment Basics: Variables

Assessment Theory and Models Part II

Reliability & Validity

Test Design & Construction

Phrenology: Gall believed that there was a relationship between the size and shape of the skull and mental faculties and character. Phrenology was based.

Tests and Measurements: Reliability

Research Methods.

Reliability and Validity

Reliability and Validity

Research Methods Lesson 2 Validity.

AREA OF STUDY 2: INTELLIGENCE & PERSONALITY

Evaluating Research Is this valid research?.

Reliability Internal External Test-retest Inter-rater

Research Methods in Psychology

Experimental Design.

Experimental Design.

Evaluating a study A very GRAVE business.

Experiment Basics: Variables

IS THE RESEARCH MEASURING WHAT IT AIMED TO MEASURE?

Evaluating a study A very GRAVE business.

Evaluating a study A very GRAVE business.

G r a v e AO3 EVALUATE GENERALISABILITY VALIDITY

Reconstruction of Automobile Destruction

Research Methods.

Reliability and Validity

AS Psychology Research Methods

Validity This refers to the extent to which the test measures what it claims to measure If an IQ test actually measures intelligence = valid However,

Validity This refers to the extent to which the test measures what it claims to measure If an IQ test actually measures intelligence = valid However,

Presentation transcript:

Reliability and Validity

What does it mean? In pairs, think of how we use the words reliability and validity in everyday life. What do these words mean? Is there a difference between them or do they mean the same thing?

Reliability When assessing the reliability of a study, we generally need to ask two questions Can the study be replicated? If so, will the results be consistent? High vs low reliability

Measuring Reliability Match the method of estimating reliability to the description (pg165) Test-Retest reliability If the measure depends upon interpretation of behaviour, we can compare the results from two or more raters. If the results in the two halves are similar, we can assume the test is reliable Split Half Reliability Splitting a test into two halves, and comparing the scores in both halves If the results on the two tests are similar, we can assume the test is reliable Inter-Rater reliability The measure is administered to the same group of people twice If there is high agreement between the raters, the measure is reliable

Validity Control Realism Generalisability Realism vs Control Did the IV cause the DV? Realism Does the experiment reflect real life? Mundane realism Generalisability Can we generalise our results to the general population? Realism vs Control

Types of Validity Internal validity External Validity What happens inside the study. External Validity How our results can be generalised beyond the study Validity of psychological measures How well our methods of measurement actually measure what we intend

Internal Validity Mundane realism Extraneous variables Task A and B Situational variables Participant variables Investigator effects Demand characteristics Participant effects Task A and B Name the variables What are the EVs and how could they have been controlled?

External Validity Read pg 165-166 and fill in the gaps

Validity of psychological measures Operationalisation of variables Can result in loss of validity

Validity of psychological measures Content validity Does the method used actually seem to measure what you intended? Concurrent validity How well does the measure agree with existing measures? Construct validity Is the method actually measuring all parts of what we are aiming to test? Predictive validity Is our measure associated with future behaviour?

Validity of psychological measures Complete tacks C, D and E.