Download presentation

Presentation is loading. Please wait.

Published byErik Creedon Modified over 6 years ago

2
Understanding the Variability of Your Data: Dependent Variable

3
Two "Sources" of Variability

4
Understanding the Variability of Your Data: Dependent Variable Two "Sources" of Variability –Independent (Predictor/Explanatory) Variable(s)

5
Understanding the Variability of Your Data: Dependent Variable Two "Sources" of Variability –Independent (Predictor/Explanatory) Variable(s) –Extraneous Variables

6
Understanding the Variability of Your Data: Dependent Variable Two Types of Variability

7
Understanding the Variability of Your Data: Dependent Variable Two Types of Variability –Unsystematic

8
Understanding the Variability of Your Data: Dependent Variable Two Types of Variability –Unsystematic –Systematic

9
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability

10
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability - unsystematic due to extraneous variables

11
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability - unsystematic due to extraneous variables Within conditions variability

12
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability - unsystematic due to extraneous variables Within conditions variability Individuals in same condition affected differently

13
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability - unsystematic due to extraneous variables Within conditions variability Individuals in same condition affected differently Affects standard deviation, not mean, in long term

14
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability - unsystematic due to extraneous variables Common sources individual differences procedural variations measurement error

15
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Primary Variability – systematic due to independent variable

16
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Primary Variability – systematic due to independent variable Between conditions variability

17
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Primary Variability – systematic due to independent variable Between conditions variability Individuals in same condition affected similarly

18
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Primary Variability – systematic due to independent variable Between conditions variability Individuals in same condition affected similarly Individuals in different conditions affected differently

19
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Primary Variability – systematic due to independent variable Between conditions variability Individuals in same condition affected similarly Individuals in different conditions affected differently Affects mean, not standard deviation, in long term

20
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Secondary Variability – systematic due to extraneous variable

21
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Secondary Variability – systematic due to extraneous variable Between conditions variability

22
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Secondary Variability – systematic due to extraneous variable Between conditions variability Individuals in same condition affected similarly

23
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Secondary Variability – systematic due to extraneous variable Between conditions variability Individuals in same condition affected similarly Individuals in different conditions affected differently

24
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Secondary Variability – systematic due to extraneous variable Between conditions variability Individuals in same condition affected similarly Individuals in different conditions affected differently Affects mean, not standard deviation, in long term

25
Understanding the Variability of Your Data: Dependent Variable Roles played in the Research Situation –Error Variability A nuisance – the ‘noise’ in the research situation

26
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability A nuisance – the ‘noise’ in the research situation –Primary Variability The focus – the potentially meaningful effect

27
Understanding the Variability of Your Data: Dependent Variable Three "labels" for the variability –Error Variability A nuisance – the ‘noise’ in the research situation –Primary Variability The focus – the potentially meaningful effect –Secondary Variability The ‘evil’ – confounds the results

28
Example Two sections of the same course

29
Example Two sections of the same course Individual’s score as combination of ‘sources’

30
Statistical decision-making The logic behind inferential statistics Deciding if there is ‘systematic variability’ –primary vs. secondary What do the data tell us? What decisions should we make?

31
Statistical decision-making A Research Example –Research Hypothesis –IF students chant the “Statistician’s Mantra” before taking their Methods exam THEN they will earn higher scores on the exam.

32
Statistical decision-making A Research Example Your Class (M = 80, SD = 15, n = 25) compared to a known population Mean (M = 70) for a standardized exam

33
Statistical decision-making A Research Example Can estimate the Sampling Distribution See if Population mean ‘fits’ Cause effect relationship not clear

34
Statistical decision-making A Research Example using experimental approach –Research Hypothesis –IF students chant the “Statistician’s Mantra” (vs. not chanting) before taking their Methods exam THEN they will earn higher scores on the exam.

35
Statistical decision-making Procedure –Randomly divide class into two groups Chanters – are taught the “Statistician’s Chant” and chant together for 5 minutes before the exam

36
Statistical decision-making Procedure –Randomly divide class into two groups Chanters – are taught the “Statistician’s Chant” and chant together for 5 minutes before the exam Non-chanters – sing Kumbaya together for 5 minutes before the exam

37
Statistical decision-making Results –Compute exam scores for all students and organize by ‘condition’ (levels of IV).

38
Show ‘changing’ distribution

39
Statistical decision-making Results –Compute exam scores for all students and organize by ‘condition’ (levels of IV). –Compare Mean Exam Scores for two Conditions

40
Statistical decision-making Results –Compute exam scores for all students and organize by ‘condition’ (levels of IV). –Compare Means Exam Scores for two Conditions –What will you find?

41
Statistical decision-making Research Hypotheses generally imprecise –Predictions are not specific –So “testing” the Research Hypothesis, using the available data, not reasonable

42
Statistical decision-making Null Hypothesis – a precise alternative –Identifies outcome expected when NO systematic variability is present

43
Statistical decision-making Null Hypothesis – a precise alternative –Identifies outcome expected when NO systematic variability is present –But still must decide how close to the predicted outcome you must be to ‘believe’ in the Null Hypothesis

44
Statistical decision-making The Null Hypothesis Sampling Distribution

45
Statistical decision-making The Null Hypothesis Sampling Distribution –All possible outcomes when the Null Hypothesis is true (when there is no ‘systematic’ variability present in the data)

46
Statistical decision-making The Null Hypothesis Sampling Distribution –All possible outcomes when the Null Hypothesis is true –Finding all the possible outcomes?

47
Statistical decision-making The Null Hypothesis Sampling Distribution –All possible outcomes when the Null Hypothesis is true –Finding all the possible outcomes? –Seeing where your results fit into the Null Hypothesis Sampling Distribution

48
Statistical decision-making Deciding what to conclude based on the ‘fit’

49
Statistical decision-making Deciding what to conclude based on the ‘fit’ “True” State of the World Ho TrueHo False Reject Ho Error Correct Rejection Decision Not Reject HoCorrect Error Nonreject

50
Statistical decision-making Deciding what to conclude based on the ‘fit’ “True” State of the World Ho TrueHo False Reject Ho Type 1 (p) Correct Rejection Decision (power = 1 – Type 2) Not Reject HoCorrect Type 2 Nonrejection Deciding what confidence you want to have that you have not made any errors

51
Statistical decision-making Trade-offs between Types of Errors –I believe I can fly?

52
Statistical decision-making Trade-offs between Types of Errors Factors affecting Type 2 Errors (Power) –“Real” systematic variability (size of effect) –Choice of Type 1 probability –Precision of estimates (sample size)

53
Statistical decision-making Trade-offs between Types of Errors Factors affecting Type 2 Errors (Power) –“Real” systematic variability (size of effect) Assume.5 * SD, a moderate size effect is good –Choice of Type 1 probability Use traditional.05 –Precision of estimates (sample size) Sample of 50 (2 groups of 25)

54
Statistical decision-making Factors affecting Type 2 Errors (Power) –Type 2 error probability =.59 –Power =.41

55
Statistical decision-making Each ‘Decision” has an associated ‘error’ Can only make Type 1 if “Reject” Can only make Type 2 if “Not Reject”

56
Statistical decision-making Interpreting “Significant” Statistical Results Having decided to “reject” the Null Hypothesis you can: –State probability of Type 1 error –State confidence interval for population value –State percent of variability in DV ‘accounted for’

57
Statistical decision-making Interpreting “Significant” Statistical Results For Chant vs. No Chant example –State probability of Type 1 error.05 –State confidence interval for population value 95% CI is approximately +2 * SE Point estimate of 10 + 8 (Real difference between 2 and 18) –State percent of variability in DV ‘accounted for’ Eta 2 =.20, or 20%

58
Statistical decision-making Interpreting “Significant” Statistical Results Statistical Significance vs. Practical Significance How unlikely is the event in these circumstance –versus How much of an effect was there

59
Statistical decision-making Interpreting “Non-significant” Statistical Results Having decide you cannot reject the Ho State the estimated ‘power’ of your design

Similar presentations

© 2022 SlidePlayer.com Inc.

All rights reserved.

To make this website work, we log user data and share it with processors. To use this website, you must agree to our Privacy Policy, including cookie policy.

Ads by Google