Presentation on theme: "Scatterplots, Association, and Correlation"— Presentation transcript:
1Scatterplots, Association, and Correlation Chapter 7
2Looking at Scatterplots Scatterplots may be the most common and most effective display for data.In a scatterplot, you can see patterns, trends, relationships, and even the occasional extraordinary value sitting apart from the others.Scatterplots are the best way to start observing the relationship and the ideal way to picture associations between two quantitative variables.
3Looking at Scatterplots Relationships between variables are often at the heart of what we’d like to learn from data:Does education level effect income?Does the cost of an athletic shoe indicate the quality of the shoe?Do students learn better with technology?
4Looking at Scatterplots When looking at scatterplots, we will look for direction, form, strength, and unusual features.Direction:A pattern that runs from the upper left to the lower right is said to have a negative direction.A trend running the other way has a positive direction.
5Looking at Scatterplots Can the NOAA predict where a hurricane will go?The figure shows a negative direction between the year since 1970 and the and the prediction errors made by NOAA.As the years have passed, the predictions have improved (errors have decreased).
6DirectionA pattern that runs from upper left to lower right is said to be negative.
7DirectionA pattern that runs from lower left to upper right is said to be positive.
8Looking at Scatterplots The example in the text shows a negative association between central pressure and maximum wind speedAs the central pressure increases, the maximum wind speed decreases.
9FormIf there is a straight line (linear) relationship, it will appear as a cloud or swarm of points stretched out in a generally consistent, straight form.
10FormIf the relationship isn’t straight, but curves gently, while still increasing or decreasing steadily, we can often find ways to make it more nearly straight.
11Form If the relationship curves sharply, the methods of this book cannot really help us.
12StrengthAt one extreme, the points appear to follow a single stream (whether straight, curved, or bending all over the place).
13StrengthAt the other extreme, the points appear as a vague cloud with no discernible trend or pattern:Note: we will quantify the amount of scatter soon.
14Unusual Features Look for the unexpected. Often the most interesting thing to see in a scatterplot is the thing you never thought to look for.One example of such a surprise is an outlier standing away from the overall pattern of the scatterplot.Clusters or subgroups should also raise questions.They may be a clue that you should split the data into subgroups rather than looking at it all together.
15What do you think the scatterplot would look like? Shoe size and grade point average?The scatterplot is likely to be randomly scattered.There is no association between shoe size and grade point average.Time for a mile run and age?The very young will probably have very high times. Older people will probably have very high times. Run times are likely to be lowest for people in their late teens and early twenties. The association is likely to be moderate and curved with no dominant direction.
16Drug dosage and pain relief? The association is likely to be positive, strong, and curved. Assuming that the drug is an effective pain reliever, the degree of pain relief is will increase. Eventually , the association is likely to level off until no further pain relief is possible since the pain is gone.Age of car and cost of repairs?The association is positive, moderate, and linear. As cars get older, they usually require more repairs.
17Roles for VariablesIt is important to determine which of the two quantitative variables goes on the x-axis and which on the y-axis.This determination is made based on the roles played by the variables.When the roles are clear, the explanatory or predictor variable goes on the x-axis, and the response variable (variable of interest) goes on the y-axis.
18Roles for VariablesThe roles that we choose for variables are more about how we think about them rather than about the variables themselves.Just placing a variable on the x-axis doesn’t necessarily mean that it explains or predicts anything. And the variable on the y-axis may not respond to it in any way.
19ExampleSuppose you were to collect data for each pair of variables listed below. You want to make a scatterplot. Which variable would you use as the explanatory variable and which is the response variable? Why? Discuss the likely direction, form, and strength.A. When climbing a mountain: altitude, temperatureExplanatory – altitude; Response – temperatureTo predict temperature based on altitude. Scatterplot: negative, possibly straight, moderate
20People: Age, grip strength Explanatory – age; Response – grip strengthTo predict grip strength based on age. Scatterplot: curved down, moderate. Very young and elderly would have less grip strength than adultsDrivers: blood alcohol level, reaction timeExplanatory – blood alcohol level; Response – reaction time and other way around To predict reaction time based on blood alcohol level. Scatterplot: positive, nonlinear, moderately strong
21CorrelationData collected from students in Statistics classes included their heights (in inches) and weights (in pounds):Here we see a positive association and a fairly straight form, although there seems to be a high outlier.
22CorrelationHow strong is the association between weight and height of Statistics students?If we had to put a number on the strength, we would not want it to depend on the units we used.A scatterplot of heights (in centimeters) and weights (in kilograms) doesn’t change the shape of the pattern:
23CorrelationSince the units don’t matter, why not remove them altogether?We could standardize both variables and write the coordinates of a point as (zx, zy).Here is a scatterplot of the standardized weights and heights:
24CorrelationNote that the underlying linear pattern seems steeper in the standardized plot than in the original scatterplot.That’s because we made the scales of the axes the same.Equal scaling gives a neutral way of drawing the scatterplot and a fairer impression of the strength of the association.
25CorrelationSome points (those in green) strengthen the impression of a positive association between height and weight.Other points (those in red) tend to weaken the positive association.Points with z-scores of zero (those in blue) don’t vote either way.
26CorrelationThe correlation coefficient (r) gives us a numerical measurement of the strength of the linear relationship between the explanatory and response variables.
27CorrelationFor the students’ heights and weights, the correlation isWhat does this mean in terms of strength? We’ll address this shortly.
28TI DirectionsSee directions on page 145 to enter points for a scatterplotPass out example
29Correlation Conditions Correlation measures the strength of the linear association between two quantitative variables.Before you use correlation, you must check several conditions:Quantitative Variables ConditionStraight Enough ConditionOutlier Condition
30Quantitative Variables Condition: Correlation applies only to quantitative variables.Don’t apply correlation to categorical data masquerading as quantitative.Check that you know the variables’ units and what they measure.
31Straight Enough Condition: You can calculate a correlation coefficient for any pair of variables.But correlation measures the strength only of the linear association, and will be misleading if the relationship is not linear.
32Outlier Condition: Outliers can distort the correlation dramatically. An outlier can make an otherwise small correlation look big or hide a large correlation.It can even give an otherwise positive association a negative correlation coefficient (and vice versa).When you see an outlier, it’s often a good idea to report the correlations with and without the point.
33Checkpoint exerciseYour statistics teacher tells you the correlation between the scores on exam one and exam 2 was 0.75.Before answering any questions about the correlation, what would you like to see and how?Scores are quantitative. Check if the straight enough condition and outlier condition are satisfied by looking at scatterplots.
34If she adds 10 points to each exam one score, how will it change the correlation? It won’t change.If she standardizes both scores how will this affect the correlation?It won’t change
35In general, if someone does poorly on exam 1, are they likely to do poorly or well on exam 2? Why? They are more likely to do poorly. The positive correlation means that low scores on exam 1 are associated with low scores on exam 2.If someone does poorly on exam 1, will they definitely do poorly on exam 2 as well?No. The general association is positive, but individual performances may vary.
36Correlation Properties The sign of a correlation coefficient gives the direction of the association.Correlation is always between –1 and +1.Correlation can be exactly equal to –1 or +1, but these values are unusual in real data because they mean that all the data points fall exactly on a single straight line.A correlation near zero corresponds to a weak linear association.
37Correlation Properties Correlation treats x and y symmetrically:The correlation of x with y is the same as the correlation of y with x.Correlation has no units.Correlation is not affected by changes in the center or scale of either variable.Correlation depends only on the z-scores, and they are unaffected by changes in center or scale.
38Correlation Properties Correlation measures the strength of the linear association between the two variables.Variables can have a strong association but still have a small correlation if the association isn’t linear.Correlation is sensitive to outliers. A single outlying value can make a small correlation large or make a large one small.
39How strong is strong?There is NO agreement on characterizations such as “weak”, “moderate” or “strong.”To use these words adds a value judgment to the to the numerical summary that correlation provides. What is weak in one context may be strong in another.Tell the correlation and show the scatterplot, others can judge for themselves.
40Correlation ≠ Causation Whenever we have a strong correlation, it is tempting to explain it by imagining that the predictor variable has caused the response to help.Scatterplots and correlation coefficients never prove causation.A hidden variable that stands behind a relationship and determines it by simultaneously affecting the other two variables is called a lurking variable.
41Correlation TablesIt is common in some fields to compute the correlations between each pair of variables in a collection of variables and arrange these correlations in a table.
42Be careful with correlation tables! Presenting the correlations without the checks for linearity and outliers, the table risks showing truly small correlations have been inflated by outliers, truly large correlations that are hidden by outliers, and correlations of any size that may be meaningless because the form is not linear.
43How to find the correlation coefficient Year (Let = 0)Tuition in dollars654616996237350475005797868377787108911099411109800Directions p. 151
44Straightening Scatterplots P. 166 #35 Create scatterplot and describe the association. (Direction, form, strength!)The association between position number of each planet and its distance from the sun is very strong, positive, and curved.
45Why would you not want to talk about the correlation between planet position and distance from the sun?It’s not linear. Correlation is a measure of the degree of linear association between two variables.
46Make a scatterplot showing the logarithm of the distance vs. position Make a scatterplot showing the logarithm of the distance vs. position. What is better about this scatterplot?Log(L2)storL3Still shows a curve but it is straight enough that correlation may now be used.