Section 10.3-1 Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.

Slides:



Advertisements
Similar presentations
Section 10-3 Regression.
Advertisements

Copyright © 2010 Pearson Education, Inc. Slide
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Correlation and Regression
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Summarizing Bivariate Data Introduction to Linear Regression.
Regression Chapter 10 Understandable Statistics Ninth Edition By Brase and Brase Prepared by Yixun Shi Bloomsburg University of Pennsylvania.
CHAPTER 3 Describing Relationships
Correlation and Regression Analysis
Copyright ©2006 Brooks/Cole, a division of Thomson Learning, Inc. More About Regression Chapter 14.
1 Chapter 10 Correlation and Regression We deal with two variables, x and y. Main goal: Investigate how x and y are related, or correlated; how much they.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Correlation & Regression
Descriptive Methods in Regression and Correlation
Linear Regression.
Chapter 10 Correlation and Regression
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Section 10-3 Regression.
Relationship of two variables
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
Correlation.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Chapter 13 Statistics © 2008 Pearson Addison-Wesley. All rights reserved.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Section 10-1 Review and Preview.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Probabilistic and Statistical Techniques 1 Lecture 24 Eng. Ismail Zakaria El Daour 2010.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Lecture Slides Elementary Statistics Eleventh Edition and the Triola.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
1 Chapter 10 Correlation and Regression 10.2 Correlation 10.3 Regression.
Chapter 10 Correlation and Regression
Copyright © 2011 Pearson Education, Inc. The Simple Regression Model Chapter 21.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 12: Analyzing the Association Between Quantitative Variables: Regression Analysis Section.
Basic Concepts of Correlation. Definition A correlation exists between two variables when the values of one are somehow associated with the values of.
Slide Slide 1 Warm Up Page 536; #16 and #18 For each number, answer the question in the book but also: 1)Prove whether or not there is a linear correlation.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Relationships If we are doing a study which involves more than one variable, how can we tell if there is a relationship between two (or more) of the.
Copyright ©2011 Brooks/Cole, Cengage Learning Inference about Simple Regression Chapter 14 1.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 3 Describing Relationships 3.2 Least-Squares.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 21 The Simple Regression Model.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Agresti/Franklin Statistics, 1 of 88 Chapter 11 Analyzing Association Between Quantitative Variables: Regression Analysis Learn…. To use regression analysis.
Chapter 14: Inference for Regression. A brief review of chapter 4... (Regression Analysis: Exploring Association BetweenVariables )  Bi-variate data.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Chapter 10 Correlation and Regression 10-2 Correlation 10-3 Regression.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Lecture Slides Elementary Statistics Tenth Edition and the.
Slide Slide 1 Chapter 10 Correlation and Regression 10-1 Overview 10-2 Correlation 10-3 Regression 10-4 Variation and Prediction Intervals 10-5 Multiple.
Slide 1 Copyright © 2004 Pearson Education, Inc. Chapter 10 Correlation and Regression 10-1 Overview Overview 10-2 Correlation 10-3 Regression-3 Regression.
1 Objective Given two linearly correlated variables (x and y), find the linear function (equation) that best describes the trend. Section 10.3 Regression.
Chapter 13 Lesson 13.2a Simple Linear Regression and Correlation: Inferential Methods 13.2: Inferences About the Slope of the Population Regression Line.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Lecture Slides Elementary Statistics Twelfth Edition
Linear Regression Essentials Line Basics y = mx + b vs. Definitions
Elementary Statistics
CHS 221 Biostatistics Dr. wajed Hatamleh
Elementary Statistics
Lecture Slides Elementary Statistics Thirteenth Edition
CHAPTER 29: Multiple Regression*
CHAPTER 26: Inference for Regression
Lecture Slides Elementary Statistics Twelfth Edition
Chapter 10 Correlation and Regression
No notecard for this quiz!!
CHAPTER 3 Describing Relationships
Lecture Slides Elementary Statistics Eleventh Edition
Lecture Slides Elementary Statistics Twelfth Edition
Lecture Slides Elementary Statistics Eleventh Edition
Algebra Review The equation of a straight line y = mx + b
A medical researcher wishes to determine how the dosage (in mg) of a drug affects the heart rate of the patient. Find the correlation coefficient & interpret.
Created by Erin Hodgess, Houston, Texas
Presentation transcript:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series by Mario F. Triola

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Chapter 10 Correlation and Regression 10-1 Review and Preview 10-2 Correlation 10-3 Regression 10-4 Prediction Intervals and Variation 10-5 Multiple Regression 10-6 Nonlinear Regression

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Key Concept In Part 1 of this section we find the equation of the straight line that best fits the paired sample data. That equation algebraically describes the relationship between two variables. The best-fitting straight line is called a regression line and its equation is called the regression equation. In Part 2, we discuss marginal change, influential points, and residual plots as tools for analyzing correlation and regression results.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Part 1: Basic Concepts of Regression

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Regression The typical equation of a straight line y = mx + b is expressed in the form ŷ = b 0 + b 1 x, where b 0 is the y -intercept and b 1 is the slope. The regression equation expresses a relationship between x (called the explanatory variable, predictor variable or independent variable), and ŷ (called the response variable or dependent variable).

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Definitions Regression Equation: Given a collection of paired sample data, the regression line (or line of best fit, or least- squares line) is the straight line that “best” fits the scatterplot of data. The regression equation ŷ = b 0 + b 1 x algebraically describes the regression line.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Notation for Regression Equation Population Parameter Sample Statistic y-Intercept of regression equation β0β0 b0b0 Slope of regression equation β1β1 b1b1 Equation of the regression line y = β 0 + β 1 x ŷ = b 0 + b 1 x

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Requirements 1. The sample of paired (x, y) data is a random sample of quantitative data. 2. Visual examination of the scatterplot shows that the points approximate a straight-line pattern. 3. Any outliers must be removed if they are known to be errors. Consider the effects of any outliers that are not known errors.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Formulas for b 1 and b 0 Technology will compute these values.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example Let us return to the example from Section We would like to use the explanatory variable, x, shoe print length, to predict the response variable, y, height. The data are listed below:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued Requirement Check: 1.The data are assumed to be a simple random sample. 2.The scatterplot showed a roughly straight-line pattern. 3.There are no outliers. The use of technology is recommended for finding the equation of a regression line.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example – Continued

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued All these technologies show that the regression equation can be expressed as: Now we use the formulas to determine the regression equation (technology is recommended).

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example Recall from the previous section that r = Technology can be used to find the values of the sample means and sample standard deviations used below. (These are the same coefficients found using technology)

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example Graph the regression equation on a scatterplot:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. 1.Use the regression equation for predictions only if the graph of the regression line on the scatterplot confirms that the regression line fits the points reasonably well. 2.Use the regression equation for predictions only if the linear correlation coefficient r indicates that there is a linear correlation between the two variables (as described in Section 10-2). Using the Regression Equation for Predictions

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. 3.Use the regression line for predictions only if the data do not go much beyond the scope of the available sample data. (Predicting too far beyond the scope of the available sample data is called extrapolation, and it could result in bad predictions.) 4.If the regression equation does not appear to be useful for making predictions, the best predicted value of a variable is its sample mean. Using the Regression Equation for Predictions

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Strategy for Predicting Values of y

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. If the regression equation is not a good model, the best predicted value of y is simply, the mean of the y values. Remember, this strategy applies to linear patterns of points in a scatterplot. If the scatterplot shows a pattern that is not a straight-line pattern, other methods apply, as described in Section Using the Regression Equation for Predictions

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example Use the 5 pairs of shoe print lengths and heights to predict the height of a person with a shoe print length of 29 cm. The regression line does not fit the points well. The correlation is r = 0.591, which suggests there is not a linear correlation (the P-value was 0.294). The best predicted height is simply the mean of the sample heights:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example Use the 40 pairs of shoe print lengths from Data Set 2 in Appendix B to predict the height of a person with a shoe print length of 29 cm. Now, the regression line does fit the points well, and the correlation of r = suggests that there is a linear correlation (the P-value is 0.000).

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued Using technology we obtain the regression equation and scatterplot:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued The given shoe length of 29 cm is not beyond the scope of the available data, so substitute in 29 cm into the regression model: A person with a shoe length of 29 cm is predicted to be cm tall.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Part 2: Beyond the Basics of Regression

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Definition In working with two variables related by a regression equation, the marginal change in a variable is the amount that it changes when the other variable changes by exactly one unit. The slope b 1 in the regression equation represents the marginal change in y that occurs when x changes by one unit.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example For the 40 pairs of shoe print lengths and heights, the regression equation was: The slope of 3.22 tells us that if we increase shoe print length by 1 cm, the predicted height of a person increases by 3.22 cm.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Definition In a scatterplot, an outlier is a point lying far away from the other data points. Paired sample data may include one or more influential points, which are points that strongly affect the graph of the regression line.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example For the 40 pairs of shoe prints and heights, observe what happens if we include this additional data point: x = 35 cm and y = 25 cm

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued The additional point is an influential point because the graph of the regression line because the graph of the regression line did change considerably. The additional point is also an outlier because it is far from the other points.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. For a pair of sample x and y values, the residual is the difference between the observed sample value of y and the y-value that is predicted by using the regression equation. That is: Definition

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Residuals

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. A residual plot is a scatterplot of the (x, y) values after each of the y-coordinate values has been replaced by the residual value y – ŷ (where ŷ denotes the predicted value of y). That is, a residual plot is a graph of the points (x, y – ŷ). Definition

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Residual Plot Analysis When analyzing a residual plot, look for a pattern in the way the points are configured, and use these criteria: The residual plot should not have any obvious patterns (not even a straight line pattern). This confirms that the scatterplot of the sample data is a straight-line pattern. The residual plot should not become thicker (or thinner) when viewed from left to right. This confirms the requirement that for different fixed values of x, the distributions of the corresponding y values all have the same standard deviation.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example The shoe print and height data are used to generate the following residual plot:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued The residual plot becomes thicker, which suggests that the requirement of equal standard deviations is violated.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued On the following slides are three residual plots. Observe what is good or bad about the individual regression models.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued Regression model is a good model:

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued Distinct pattern: sample data may not follow a straight- line pattern.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Example - Continued Residual plot becoming thicker: equal standard deviations violated.

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Complete Regression Analysis 1. Construct a scatterplot and verify that the pattern of the points is approximately a straight-line pattern without outliers. (If there are outliers, consider their effects by comparing results that include the outliers to results that exclude the outliers.) 2. Construct a residual plot and verify that there is no pattern (other than a straight-line pattern) and also verify that the residual plot does not become thicker (or thinner).

Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Complete Regression Analysis 3. Use a histogram and/or normal quantile plot to confirm that the values of the residuals have a distribution that is approximately normal. 4. Consider any effects of a pattern over time.