Presentation on theme: "Scatterplots, Association, and Correlation"— Presentation transcript:
1 Scatterplots, Association, and Correlation Chapter 7
2 Looking at Scatterplots Scatterplots may be the most common and most effective display for data.In a scatterplot, you can see patterns, trends, relationships, and even the occasional extraordinary value sitting apart from the others.Scatterplots are the best way to start observing the relationship and the ideal way to picture associations between two quantitative variables.
3 Looking at Scatterplots Relationships between variables are often at the heart of what we’d like to learn from data:Does education level effect income?Does the cost of an athletic shoe indicate the quality of the shoe?Do students learn better with technology?
4 Looking at Scatterplots When looking at scatterplots, we will look for direction, form, strength, and unusual features.Direction:A pattern that runs from the upper left to the lower right is said to have a negative direction.A trend running the other way has a positive direction.
5 Looking at Scatterplots Can the NOAA predict where a hurricane will go?The figure shows a negative direction between the year since 1970 and the and the prediction errors made by NOAA.As the years have passed, the predictions have improved (errors have decreased).
6 DirectionA pattern that runs from upper left to lower right is said to be negative.
7 DirectionA pattern that runs from lower left to upper right is said to be positive.
8 Looking at Scatterplots The example in the text shows a negative association between central pressure and maximum wind speedAs the central pressure increases, the maximum wind speed decreases.
9 FormIf there is a straight line (linear) relationship, it will appear as a cloud or swarm of points stretched out in a generally consistent, straight form.
10 FormIf the relationship isn’t straight, but curves gently, while still increasing or decreasing steadily, we can often find ways to make it more nearly straight.
11 Form If the relationship curves sharply, the methods of this book cannot really help us.
12 StrengthAt one extreme, the points appear to follow a single stream (whether straight, curved, or bending all over the place).
13 StrengthAt the other extreme, the points appear as a vague cloud with no discernible trend or pattern:Note: we will quantify the amount of scatter soon.
14 Unusual Features Look for the unexpected. Often the most interesting thing to see in a scatterplot is the thing you never thought to look for.One example of such a surprise is an outlier standing away from the overall pattern of the scatterplot.Clusters or subgroups should also raise questions.They may be a clue that you should split the data into subgroups rather than looking at it all together.
15 What do you think the scatterplot would look like? Shoe size and grade point average?The scatterplot is likely to be randomly scattered.There is no association between shoe size and grade point average.Time for a mile run and age?The very young will probably have very high times. Older people will probably have very high times. Run times are likely to be lowest for people in their late teens and early twenties. The association is likely to be moderate and curved with no dominant direction.
16 Drug dosage and pain relief? The association is likely to be positive, strong, and curved. Assuming that the drug is an effective pain reliever, the degree of pain relief is will increase. Eventually , the association is likely to level off until no further pain relief is possible since the pain is gone.Age of car and cost of repairs?The association is positive, moderate, and linear. As cars get older, they usually require more repairs.
17 Roles for VariablesIt is important to determine which of the two quantitative variables goes on the x-axis and which on the y-axis.This determination is made based on the roles played by the variables.When the roles are clear, the explanatory or predictor variable goes on the x-axis, and the response variable (variable of interest) goes on the y-axis.
18 Roles for VariablesThe roles that we choose for variables are more about how we think about them rather than about the variables themselves.Just placing a variable on the x-axis doesn’t necessarily mean that it explains or predicts anything. And the variable on the y-axis may not respond to it in any way.
19 ExampleSuppose you were to collect data for each pair of variables listed below. You want to make a scatterplot. Which variable would you use as the explanatory variable and which is the response variable? Why? Discuss the likely direction, form, and strength.A. When climbing a mountain: altitude, temperatureExplanatory – altitude; Response – temperatureTo predict temperature based on altitude. Scatterplot: negative, possibly straight, moderate
20 People: Age, grip strength Explanatory – age; Response – grip strengthTo predict grip strength based on age. Scatterplot: curved down, moderate. Very young and elderly would have less grip strength than adultsDrivers: blood alcohol level, reaction timeExplanatory – blood alcohol level; Response – reaction time and other way around To predict reaction time based on blood alcohol level. Scatterplot: positive, nonlinear, moderately strong
21 CorrelationData collected from students in Statistics classes included their heights (in inches) and weights (in pounds):Here we see a positive association and a fairly straight form, although there seems to be a high outlier.
22 CorrelationHow strong is the association between weight and height of Statistics students?If we had to put a number on the strength, we would not want it to depend on the units we used.A scatterplot of heights (in centimeters) and weights (in kilograms) doesn’t change the shape of the pattern:
23 CorrelationSince the units don’t matter, why not remove them altogether?We could standardize both variables and write the coordinates of a point as (zx, zy).Here is a scatterplot of the standardized weights and heights:
24 CorrelationNote that the underlying linear pattern seems steeper in the standardized plot than in the original scatterplot.That’s because we made the scales of the axes the same.Equal scaling gives a neutral way of drawing the scatterplot and a fairer impression of the strength of the association.
25 CorrelationSome points (those in green) strengthen the impression of a positive association between height and weight.Other points (those in red) tend to weaken the positive association.Points with z-scores of zero (those in blue) don’t vote either way.
26 CorrelationThe correlation coefficient (r) gives us a numerical measurement of the strength of the linear relationship between the explanatory and response variables.
27 CorrelationFor the students’ heights and weights, the correlation isWhat does this mean in terms of strength? We’ll address this shortly.
28 TI DirectionsSee directions on page 145 to enter points for a scatterplotPass out example
29 Correlation Conditions Correlation measures the strength of the linear association between two quantitative variables.Before you use correlation, you must check several conditions:Quantitative Variables ConditionStraight Enough ConditionOutlier Condition
30 Quantitative Variables Condition: Correlation applies only to quantitative variables.Don’t apply correlation to categorical data masquerading as quantitative.Check that you know the variables’ units and what they measure.
31 Straight Enough Condition: You can calculate a correlation coefficient for any pair of variables.But correlation measures the strength only of the linear association, and will be misleading if the relationship is not linear.
32 Outlier Condition: Outliers can distort the correlation dramatically. An outlier can make an otherwise small correlation look big or hide a large correlation.It can even give an otherwise positive association a negative correlation coefficient (and vice versa).When you see an outlier, it’s often a good idea to report the correlations with and without the point.
33 Checkpoint exerciseYour statistics teacher tells you the correlation between the scores on exam one and exam 2 was 0.75.Before answering any questions about the correlation, what would you like to see and how?Scores are quantitative. Check if the straight enough condition and outlier condition are satisfied by looking at scatterplots.
34 If she adds 10 points to each exam one score, how will it change the correlation? It won’t change.If she standardizes both scores how will this affect the correlation?It won’t change
35 In general, if someone does poorly on exam 1, are they likely to do poorly or well on exam 2? Why? They are more likely to do poorly. The positive correlation means that low scores on exam 1 are associated with low scores on exam 2.If someone does poorly on exam 1, will they definitely do poorly on exam 2 as well?No. The general association is positive, but individual performances may vary.
36 Correlation Properties The sign of a correlation coefficient gives the direction of the association.Correlation is always between –1 and +1.Correlation can be exactly equal to –1 or +1, but these values are unusual in real data because they mean that all the data points fall exactly on a single straight line.A correlation near zero corresponds to a weak linear association.
37 Correlation Properties Correlation treats x and y symmetrically:The correlation of x with y is the same as the correlation of y with x.Correlation has no units.Correlation is not affected by changes in the center or scale of either variable.Correlation depends only on the z-scores, and they are unaffected by changes in center or scale.
38 Correlation Properties Correlation measures the strength of the linear association between the two variables.Variables can have a strong association but still have a small correlation if the association isn’t linear.Correlation is sensitive to outliers. A single outlying value can make a small correlation large or make a large one small.
39 How strong is strong?There is NO agreement on characterizations such as “weak”, “moderate” or “strong.”To use these words adds a value judgment to the to the numerical summary that correlation provides. What is weak in one context may be strong in another.Tell the correlation and show the scatterplot, others can judge for themselves.
40 Correlation ≠ Causation Whenever we have a strong correlation, it is tempting to explain it by imagining that the predictor variable has caused the response to help.Scatterplots and correlation coefficients never prove causation.A hidden variable that stands behind a relationship and determines it by simultaneously affecting the other two variables is called a lurking variable.
41 Correlation TablesIt is common in some fields to compute the correlations between each pair of variables in a collection of variables and arrange these correlations in a table.
42 Be careful with correlation tables! Presenting the correlations without the checks for linearity and outliers, the table risks showing truly small correlations have been inflated by outliers, truly large correlations that are hidden by outliers, and correlations of any size that may be meaningless because the form is not linear.
43 How to find the correlation coefficient Year (Let = 0)Tuition in dollars654616996237350475005797868377787108911099411109800Directions p. 151
44 Straightening Scatterplots P. 166 #35 Create scatterplot and describe the association. (Direction, form, strength!)The association between position number of each planet and its distance from the sun is very strong, positive, and curved.
45 Why would you not want to talk about the correlation between planet position and distance from the sun?It’s not linear. Correlation is a measure of the degree of linear association between two variables.
46 Make a scatterplot showing the logarithm of the distance vs. position Make a scatterplot showing the logarithm of the distance vs. position. What is better about this scatterplot?Log(L2)storL3Still shows a curve but it is straight enough that correlation may now be used.