© Buddy Freeman, 2015 1. Independence of error assumption. In many business applications using regression, the independent variable is TIME. When the data.

Slides:



Advertisements
Similar presentations
Forecasting Using the Simple Linear Regression Model and Correlation
Advertisements

Correlation and Regression By Walden University Statsupport Team March 2011.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Inference for Regression 1Section 13.3, Page 284.
1 BA 275 Quantitative Business Methods Residual Analysis Multiple Linear Regression Adjusted R-squared Prediction Dummy Variables Agenda.
Class 5: Thurs., Sep. 23 Example of using regression to make predictions and understand the likely errors in the predictions: salaries of teachers and.
Class 6: Tuesday, Sep. 28 Section 2.4. Checking the assumptions of the simple linear regression model: –Residual plots –Normal quantile plots Outliers.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 13-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
Examining Relationship of Variables  Response (dependent) variable - measures the outcome of a study.  Explanatory (Independent) variable - explains.
Lecture 24 Multiple Regression (Sections )
REGRESSION MODEL ASSUMPTIONS. The Regression Model We have hypothesized that: y =  0 +  1 x +  | | + | | So far we focused on the regression part –
Chapter Topics Types of Regression Models
STAT 104 Section 6 Daniel Moon. Agenda Review Midterm 1 Practice Problems.
Lecture 20 Simple linear regression (18.6, 18.9)
Regression Diagnostics - I
Simple Linear Regression Analysis
Statistics 350 Lecture 10. Today Last Day: Start Chapter 3 Today: Section 3.8 Homework #3: Chapter 2 Problems (page 89-99): 13, 16,55, 56 Due: February.
BCOR 1020 Business Statistics Lecture 26 – April 24, 2007.
RESEARCH STATISTICS Jobayer Hossain Larry Holmes, Jr November 6, 2008 Examining Relationship of Variables.
Introduction to Probability and Statistics Linear Regression and Correlation.
1 4. Multiple Regression I ECON 251 Research Methods.
Linear Regression Example Data
Lecture 19 Transformations, Predictions after Transformations Other diagnostic tools: Residual plot for nonconstant variance, histogram to check normality.
1 1 Slide © 2003 South-Western/Thomson Learning™ Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Class 11: Thurs., Oct. 14 Finish transformations Example Regression Analysis Next Tuesday: Review for Midterm (I will take questions and go over practice.
Business Statistics - QBM117 Statistical inference for regression.
Guide to Using Excel For Basic Statistical Applications To Accompany Business Statistics: A Decision Making Approach, 6th Ed. Chapter 14: Multiple Regression.
1 Doing Statistics for Business Doing Statistics for Business Data, Inference, and Decision Making Marilyn K. Pelosi Theresa M. Sandifer Chapter 11 Regression.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Inference for regression - Simple linear regression
C opyright  2007 by Oxford University Press, Inc. PowerPoint Slides Prepared by Robert F. Brooker, Ph.D.Slide 1 1.
Regression Analysis (2)
Model Checking Using residuals to check the validity of the linear regression model assumptions.
Residuals and Residual Plots Most likely a linear regression will not fit the data perfectly. The residual (e) for each data point is the ________________________.
Data Collection & Processing Hand Grip Strength P textbook.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
1 1 Slide © 2012 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
1 1 Slide Simple Linear Regression Part A n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n.
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
The Examination of Residuals. Examination of Residuals The fitting of models to data is done using an iterative approach. The first step is to fit a simple.
Economics 173 Business Statistics Lecture 20 Fall, 2001© Professor J. Petry
Chapter 5: Regression Analysis Part 1: Simple Linear Regression.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Why Model? Make predictions or forecasts where we don’t have data.
Review of Building Multiple Regression Models Generalization of univariate linear regression models. One unit of data with a value of dependent variable.
Maths Study Centre CB Open 11am – 5pm Semester Weekdays
Problem 3.26, when assumptions are violated 1. Estimates of terms: We can estimate the mean response for Failure Time for problem 3.26 from the data by.
1 Regression Analysis The contents in this chapter are from Chapters of the textbook. The cntry15.sav data will be used. The data collected 15 countries’
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Model Building and Model Diagnostics Chapter 15.
Residual Analysis Purposes –Examine Functional Form (Linear vs. Non- Linear Model) –Evaluate Violations of Assumptions Graphical Analysis of Residuals.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Statistics for Managers Using Microsoft® Excel 5th Edition
Stat 112 Notes 14 Assessing the assumptions of the multiple regression model and remedies when assumptions are not met (Chapter 6).
Maths Study Centre CB Open 11am – 5pm Semester Weekdays
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Chapter 12: Correlation and Linear Regression 1.
1 Assessment and Interpretation: MBA Program Admission Policy The dean of a large university wants to raise the admission standards to the popular MBA.
Quantitative Methods Residual Analysis Multiple Linear Regression C.W. Jackson/B. K. Gordor.
Inference for Least Squares Lines
distance prediction observed y value predicted value zero
Chapter 12: Regression Diagnostics
Model diagnostics Tim Paine, modified from Zarah Pattison’s slides
Diagnostics and Transformation for SLR
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Chapter 13 Additional Topics in Regression Analysis
Inference for Regression Slope
Essentials of Statistics for Business and Economics (8e)
Diagnostics and Transformation for SLR
Presentation transcript:

© Buddy Freeman, Independence of error assumption. In many business applications using regression, the independent variable is TIME. When the data (Y i ) is collected at regular intervals of time you have a time series. In such cases the errors are likely not to be independent of one another. That is, the error in time frame t is probably correlated with the error in time frame (t+1). If this situation exists, it violates the independence of error assumption, and any results derived from the regression model (however perfect the "fit" may be) are questionable.

© Buddy Freeman, 2015 Each Excel workbook in S:\BFREEMAN\QM3620\Course Files\Segment3\ExcelFiles\Simple Linear Regression and Correlation contains a worksheet labeled “Independence of Error” that provides the calculation of the Durbin-Watson statistic to test for such violations. However, the test is not always yes or no. It has a “we are not sure” portion. You need a table of "ranges" to determine if: (a) The assumption is valid for our model and . (b) The assumption is not valid for our model and . (c) We are not sure if the assumption is valid or not for our model and .

© Buddy Freeman, Equality of Variances assumption. This assumption can be tested by examining a plot with the predicted values on the horizontal (X axis) and the “standardized errors” (Studentized residuals) on the vertical (Y axis). Each Excel workbook in S:\BFREEMAN\QM3620\Course Files\Segment3\ExcelFiles\Simple Linear Regression and Correlation contains a worksheet labeled “Equal Variances” that provides the values of the Studentized residuals and the predicted values used to generate a graph to test for such violations. To make the graph display the data properly, one has to set the X Values to the range of Predicted Y values in column B.

© Buddy Freeman, 2015 If this assumption is violated you will probably see "triangular" patterns. If the pattern has a fairly constant "height" across the range of the predicted values, the assumption is probably valid. Even if it is violated, sometimes you can still come up with a valid model by applying a "correcting" transformation.

© Buddy Freeman, Normality assumption. You can use the Histogram tool in Excel’s Data Analysis Tools to build a histogram of the errors and see if they appear to be normally distributed. As long as it is not "too" nonnormal, you will have a valid model. Regression is "robust" with respect to the normality assumption. For a more rigorous normality test, you may use the use the Anderson-Darling goodness-of-fit test for normality.

© Buddy Freeman, 2015 Each Excel workbook in S:\BFREEMAN\QM3620\Course Files\Segment3\ExcelFiles\Simple Linear Regression and Correlation contains a worksheet labeled “Normality” that provides the values of the errors (Residuals). Use the cursor to select all the Residuals. Copy them and perform a paste special (Values) under the heading “Sorted Residuals.” Click on the symbol at the top to sort these values into ascending order. The approximate P-Value may then be used to assess the assumption of normality. AZAZ