IS THE RESEARCH MEASURING WHAT IT AIMED TO MEASURE? VALIDITY IS THE RESEARCH MEASURING WHAT IT AIMED TO MEASURE?

Validity Objectivity Re-cap: Match the key term to the definition The extent to which findings and conclusions from experiments can be broadly applied to the population because the sample of participants is representative. The extent to which the findings from research can be achieved again if the experiment was repeated or replicated. The extent to which the research can be generalised to other settings. E.g. the real world. The extent to which a test measures what it set out to test and is uninfluenced by outside variables. Findings are accurate. When experimental findings are uninfluenced by personal opinions and are therefore free from bias. Validity External Validity Reliability Generalisability Objectivity Crucial point ! These only apply to STUDIES not THEORIES. What’s the difference between a theory and a study?

Dart’s Analogy Which represents validity? https://www.youtube.com/watch?v=aEoL5g6HNsI

Reliability and Validity Reliable = consistent Valid = precise

But what does validity mean in the context of Psychology? Validity = Precision. Precision = we know that the changes to the IV by an experimenter in a study have caused the effect on the DV, without anything else (EVs) getting in the way. This is also known as internal validity. External validity = concerns how far the results of the study can be applied beyond the study itself. (i.e. to the real world).

Application to Studies Milgram (Social Influence) State whether this study is high or low in internal validity and external validity. Justify why For low internal/external validity suggest a way that the validity could be improved in this study.

Here is an example evaluation point Can you spot the mistakes and correct them? AO3 point 2. One strength of Milgram’s study is that it is high in external validity. He conducted the study in a laboratory setting in a University. The variables were controlled and extraneous variables kept to a minimum. The experiment was rigged by Milgram and he manipulated the situation using a confederate. This means that that the results he found were objective, free from bias and therefore externally valid. We can ensure that the obedience level measured was accurate.

All evaluation should be effective Explain your points in depth and if you use validity to evaluate a study, explain it to the examiner. Show them you understand what it means. Use at least 3 x ‘because.’ One weakness of Milgram’s study is that it was conducted in an artificial lab setting. This matters because the conditions were too controlled and the obedience found could simply be a result of the manipulations made by the experimenter. This means it has low external validity because the conditions did not represent real life everyday situations. This is a weakness because the results can not be generalised to explain obedience in the real world.

New Rule You may only use ‘Validity’ when evaluating a study if you refer to a specific type! Internal OR External.

Top Tip: Revisit essays written & correct errors. Now revisit your own written work and essays. Correct any errors where you have misused validity or reliability or used them ineffectively. Be sure to be precise and state/explain the different types. Do this in green!

EXPERIMENTAL (INTERNAL) VALIDITY… Did Orne & Holland (1968) criticise Milgram’s study for lack of Experimental (Internal) Validity or Ecological (External) Validity ? EXPERIMENTAL (INTERNAL) VALIDITY… …is a measure of whether experimental procedures actually work and the results are genuine! e.g. The controls (did anything else affect PPs?) The measurements (accurate & meaningful?) The demand characteristics (could PPs work out the aims & change their behaviour?)

2. Ecological (External) Validity… …The extent to which the study’s results can be generalised beyond the research situation e.g. The setting (was it realistic?) The sample (was it representative? What about females, or the elderly?) The task (does it have mudane realism?)

Grab a white board a pen and a wiper LOW v HIGH VALIDITY GAME Grab a white board a pen and a wiper

EXPERIMENTAL (INTERNAL) VALIDITY Milgram argued that the distress shown by the PPs taking part was evidence of the fact that they believed they were administering real electric shocks to the learner. He said they did this because they were ordered to do so. HIGH VALIDITY!

It means the findings are Reliable –nothing to do with validity The study was repeated many times using the same procedure! It means the findings are Reliable –nothing to do with validity

Participants may have only shocked the learner as they were paid to take part and were bound to a contract. They were not being obedient This would suggest LOW INTERNAL VALIDITY. Is being obligated the same as being obedient?

Does this point indicate the research has high or low validity? Orne and Holland (1968) argue that the participants did not believe the experiment was real, they said the ppts did not think they were really hurting the learner. Does this point indicate the research has high or low validity? LOW INTERNAL VALIDITY!

HIGH INTERNAL VALIDITY! Milgram asked participants after the study (using a questionnaire) if they thought it was fake, they all responded that they thought it was real. HIGH INTERNAL VALIDITY!

Ecological (external) validity Research conducted in other countries (following the same procedure) found varying levels of obedience: Holland, Germany and Austria were more obedient. Britain and Australia were less obedient LOW ECOLOGICAL VALIDITY!

HIGH ECOLOGICAL VALIDITY! Hoffling (1966) repeated the study in a real life setting in a hospital and got similar results showing obedience is high in real life situation HIGH ECOLOGICAL VALIDITY!

LOW ECOLOGICAL VALIDITY Rank and Jacobson carried out an obedience study on nurses on a known drug. The nurses were not obedient. This contradicts Milgram’s and Hofling’s findings LOW ECOLOGICAL VALIDITY

LOW ECOLOGICAL VALIDITY! When Milgram repeated his study in run down offices the obedience rate was lower suggesting the setting affected obedience LOW ECOLOGICAL VALIDITY!

HIGH ECOLOGICAL VALIDITY! When study was conducted with females, similar results were shown! HIGH ECOLOGICAL VALIDITY!

WHY DO OEDIENCE LEVELS VARY IN THE STUDIES LOOKED AT SO FAR….?

Create your own way of explaining the following reasons for obedience.. Legitimate authority Gradual commitment Contractual Obligation The agentic shift Buffers Personality Factors

Independent behaviour ‘Going against the pressure to conform or obey so that behaviour is not altered.’ Why do you think this might occur?