Presentation is loading. Please wait.

Presentation is loading. Please wait.

Understanding Regression Analysis Basics. Copyright © 2014 Pearson Education, Inc. 15-2 Learning Objectives To understand the basic concept of prediction.

Similar presentations


Presentation on theme: "Understanding Regression Analysis Basics. Copyright © 2014 Pearson Education, Inc. 15-2 Learning Objectives To understand the basic concept of prediction."— Presentation transcript:

1 Understanding Regression Analysis Basics

2 Copyright © 2014 Pearson Education, Inc. 15-2 Learning Objectives To understand the basic concept of prediction To learn how marketing researchers use regression analysis To learn how marketing researchers use bivariate regression analysis

3 Copyright © 2014 Pearson Education, Inc. 15-3 Learning Objectives To see how multiple regression differs from bivariate regression To learn how to obtain and interpret multiple regression analyses with SPSS

4 Copyright © 2014 Pearson Education, Inc. 15-4

5 Copyright © 2014 Pearson Education, Inc. 15-5 Bivariate Linear Regression Analysis Regression analysis is a predictive analysis technique in which one or more variables are used to predict the level of another by use of the straight-line formula. Bivariate regression means only two variables are being analyzed, and researchers sometimes refer to this case as “simple regression.”

6 Copyright © 2014 Pearson Education, Inc. 15-6 Bivariate Linear Regression Analysis With bivariate analysis, one variable is used to predict another variable. The straight-line equation is the basis of regression analysis.

7 Copyright © 2014 Pearson Education, Inc. 15-7 Bivariate Linear Regression Analysis Figure 15.1 General Equation for a Straight Line in Graph Form

8 Copyright © 2014 Pearson Education, Inc. 15-8 Basic Regression Analysis Concepts Independent variable: used to predict the independent variable (x in the regression straight-line equation) Dependent variable: that which is predicted (y in the regression straight-line equation)

9 Copyright © 2014 Pearson Education, Inc. 15-9 Improving Regression Analysis Identify any outlier: a data point that is substantially outside the normal range of the data points being analyzed

10 Copyright © 2014 Pearson Education, Inc. 15-10 Computing the Slope and the Intercept Least squares criterion: used in regression analysis; guarantees that the “best” straight-line slope and intercept will be calculated

11 Copyright © 2014 Pearson Education, Inc. 15-11 Multiple Regression Analysis Multiple regression analysis uses the same concepts as bivariate regression analysis but uses more than one independent variable. A general conceptual model identifies independent and dependent variables and shows their basic relationships to one another.

12 Copyright © 2014 Pearson Education, Inc. 15-12 Multiple Regression Analysis Described Multiple regression means that you have more than one independent variable to predict a single dependent variable. With multiple regression, the regression plane is the shape of the dependent variables.

13 Copyright © 2014 Pearson Education, Inc. 15-13 Basic Assumptions in Multiple Regression

14 Copyright © 2014 Pearson Education, Inc. 15-14 Example of Multiple Regression We wish to predict customers’ intentions to purchase a Lexus automobile. We performed a survey that included an attitude- toward-Lexus variable, a word-of-mouth variable, and an income variable.

15 Copyright © 2014 Pearson Education, Inc. 15-15 Example of Multiple Regression Here is the resultant equation:

16 Copyright © 2014 Pearson Education, Inc. 15-16 Example of Multiple Regression This multiple regression equation means that we can predict a consumer’s intention to buy a Lexus level if you know three variables: Attitude toward Lexus Friends’ negative comments about Lexus Income level using a scale with 10 income levels

17 Copyright © 2014 Pearson Education, Inc. 15-17 Example of Multiple Regression Calculation of one buyer’s Lexus purchase intention using the multiple regression equation:

18 Copyright © 2014 Pearson Education, Inc. 15-18 Example of Multiple Regression Multiple regression is a powerful tool because it tells us the following: Which factors predict the dependent variable Which way (the sign) each factor influences the dependent variable How much (the size of bi) each factor influences it

19 Copyright © 2014 Pearson Education, Inc. 15-19 Multiple R Multiple R, also called the coefficient of determination, is a measure of the strength of the overall linear relationship in multiple regression. It indicates how well the independent variables can predict the dependent variable.

20 Copyright © 2014 Pearson Education, Inc. 15-20 Multiple R Multiple R ranges from 0 to +1 and represents the amount of the dependent variable that is “explained,” or accounted for, by the combined independent variables.

21 Copyright © 2014 Pearson Education, Inc. 15-21 Multiple R Researchers convert the multiple R into a percentage: multiple R of.75 means that the regression findings will explain 75% of the dependent variable.

22 Copyright © 2014 Pearson Education, Inc. 15-22 Basic Assumptions of Multiple Regression Independence assumption: the independent variables must be statistically independent and uncorrelated with one another (the presence of strong correlations among independent variables is called multicollinearity).

23 Copyright © 2014 Pearson Education, Inc. 15-23 Basic Assumptions of Multiple Regression Variance inflation factor (VIF): can be used to assess and eliminate multicollinearity VIF is a statistical value that identifies what independent variable(s) contribute to multicollinearity and should be removed. Any variable with VIF of greater than 10 should be removed.

24 Copyright © 2014 Pearson Education, Inc. 15-24 Basic Assumptions in Multiple Regression The inclusion of each independent variable preserves the straight-line assumptions of multiple regression analysis. This is sometimes known as additivity because each new independent variable is added to the regression equation.

25 Copyright © 2014 Pearson Education, Inc. 15-25 Figure 15.3 SPSS Clickstream for Multiple Regression Analysis Source: Reprint courtesy of International Business Machines Corporation, © SPSS, Inc., an IBM Company.

26 Copyright © 2014 Pearson Education, Inc. 15-26 Figure 15.4 SPSS Output for Multiple Regression Analysis Source: Reprint courtesy of International Business Machines Corporation, ©SPSS, Inc., an IBM Company.

27 Copyright © 2014 Pearson Education, Inc. 15-27 “Trimming” the Regression A trimmed regression means that you eliminate the nonsignificant independent variables and then rerun the regression. Run trimmed regressions iteratively until all betas are significant. The resultant regression model expresses the salient independent variables.

28 Copyright © 2014 Pearson Education, Inc. 15-28 Figure 15.5 SPSS Output for Trimmed Multiple Regression Analysis Source: Reprint courtesy of International Business Machines Corporation, ©SPSS, Inc., an IBM Company.

29 Copyright © 2014 Pearson Education, Inc. 15-29 Special Uses of Multiple Regression Dummy independent variable: scales with a nominal 0-versus-1 coding scheme Using standardized betas to compare independent variables: allows direct comparison of each independent value Using multiple regression as a screening device: identify variables to exclude

30 Copyright © 2014 Pearson Education, Inc. 15-30 Stepwise Multiple Regression Stepwise regression is useful when there are many independent variables and a researcher wants to narrow the set down to a smaller number of statistically significant variables.

31 Copyright © 2014 Pearson Education, Inc. 15-31 Stepwise Multiple Regression The one independent variable that is statistically significant and explains the most variance is entered first into the multiple regression equation. Then, each statistically significant independent variable is added in order of variance explained. All insignificant independent variables are excluded.

32 Copyright © 2014 Pearson Education, Inc. 15-32

33 Copyright © 2014 Pearson Education, Inc. 15-33 Regression Analysis Concepts

34 Copyright © 2014 Pearson Education, Inc. 15-34 Regression Analysis Concepts

35 Copyright © 2014 Pearson Education, Inc. 15-35 Regression Analysis Concepts

36 Copyright © 2014 Pearson Education, Inc. 15-36 Three Warnings Regarding Multiple Regression Analysis Regression is a statistical tool, not a cause-and-effect statement. Regression analysis should not be applied outside the boundaries of data used to develop the regression model. Chapter 15 is simplified; regression analysis is complex and requires additional study.

37 Copyright © 2014 Pearson Education, Inc. 15-37 Reporting Findings to Clients Most important when used as a screening device: Dependent variable Statistically significant independent variables Signs of beta coefficients Standardized bets coefficients for significant variables

38 Copyright © 2014 Pearson Education, Inc. 15-38 Example

39 Copyright © 2014 Pearson Education, Inc. 15-39 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission of the publisher. Printed in the United States of America.


Download ppt "Understanding Regression Analysis Basics. Copyright © 2014 Pearson Education, Inc. 15-2 Learning Objectives To understand the basic concept of prediction."

Similar presentations


Ads by Google