Chapter 12: Regression Diagnostics

Slides:



Advertisements
Similar presentations
Forecasting Using the Simple Linear Regression Model and Correlation
Advertisements

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Chapter 4 Describing the Relation Between Two Variables 4.3 Diagnostics on the Least-squares Regression Line.
Prediction, Correlation, and Lack of Fit in Regression (§11. 4, 11
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: What it Is and How it Works. Overview What is Bivariate Linear Regression? The Regression Equation How It’s Based on r Assumptions.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Regression Analysis. Unscheduled Maintenance Issue: l 36 flight squadrons l Each experiences unscheduled maintenance actions (UMAs) l UMAs costs $1000.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Class 6: Tuesday, Sep. 28 Section 2.4. Checking the assumptions of the simple linear regression model: –Residual plots –Normal quantile plots Outliers.
Lecture 20 Simple linear regression (18.6, 18.9)
Regression Diagnostics - I
Statistical Analysis SC504/HS927 Spring Term 2008 Session 7: Week 23: 7 th March 2008 Complex independent variables and regression diagnostics.
BCOR 1020 Business Statistics Lecture 26 – April 24, 2007.
Quantitative Business Analysis for Decision Making Simple Linear Regression.
Slide Copyright © 2010 Pearson Education, Inc. Active Learning Lecture Slides For use with Classroom Response Systems Business Statistics First Edition.
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Business Statistics - QBM117 Statistical inference for regression.
Correlation and Regression Analysis
Multiple Regression Dr. Andy Field.
Simple Linear Regression Analysis
Lecture 5 Correlation and Regression
Correlation & Regression
Regression and Correlation Methods Judy Zhong Ph.D.
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Simple Linear Regression Models
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Chapter 14 Inference for Regression © 2011 Pearson Education, Inc. 1 Business Statistics: A First Course.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
1 Regression Analysis The contents in this chapter are from Chapters of the textbook. The cntry15.sav data will be used. The data collected 15 countries’
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
Multivariate Data Analysis Chapter 2 – Examining Your Data
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
Lab 4 Multiple Linear Regression. Meaning  An extension of simple linear regression  It models the mean of a response variable as a linear function.
Univariate Point Estimation Confidence Interval Estimation Bivariate: Linear Regression Multivariate: Multiple Regression 1 Chapter 4: Statistical Approaches.
Chapter 12: Correlation and Linear Regression 1.
Simple Linear Regression and Correlation (Continue..,) Reference: Chapter 17 of Statistics for Management and Economics, 7 th Edition, Gerald Keller. 1.
Chapter 11: Linear Regression E370, Spring From Simple Regression to Multiple Regression.
Quantitative Methods Residual Analysis Multiple Linear Regression C.W. Jackson/B. K. Gordor.
Using the regression equation (17.6). Why regression? 1.Analyze specific relations between Y and X. How is Y related to X? 2.Forecast / Predict the variable.
Chapter 12 REGRESSION DIAGNOSTICS AND CANONICAL CORRELATION.
Yandell – Econ 216 Chap 15-1 Chapter 15 Multiple Regression Model Building.
Predicting Energy Consumption in Buildings using Multiple Linear Regression Introduction Linear regression is used to model energy consumption in buildings.
The simple linear regression model and parameter estimation
Inference for Least Squares Lines
Correlation, Bivariate Regression, and Multiple Regression
Multiple Regression Prof. Andy Field.
AP Statistics Chapter 14 Section 1.
Basic Estimation Techniques
Cautions about Correlation and Regression
BIVARIATE REGRESSION AND CORRELATION
Basic Estimation Techniques
Lecture 14 Review of Lecture 13 What we’ll talk about today?
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
Chapter 14 – Correlation and Simple Regression
Residuals The residuals are estimate of the error
Chapter 17 – Simple Linear Regression and Correlation
Regression is the Most Used and Most Abused Technique in Statistics
Adequacy of Linear Regression Models
Regression Forecasting and Model Building
Checking Assumptions Primary Assumptions Secondary Assumptions
Chapter 13 Additional Topics in Regression Analysis
Chapter 6 Predicting Future Performance
Presentation transcript:

Chapter 12: Regression Diagnostics E370, Spring 2016

Assumptions Data Data Accuracy Measurement accuracy Outliers Observations that may dramatically affect the results of a regression Model Linear relationship The dependent variable is related with the independent variables in a linear fashion. Absence of Multicollinearity Independent variables are not highly correlated with each other

Data Check Check range, mean and other descriptive statistics for data accuracy Outliers: Too far of the predicted value--- Standardized residuals’ absolute value higher than 3 Influential outliers: whose exclusion dramatically changed the coefficients.

Absence of Multicollinearity Check pair-wise correlation coefficients Correlation coefficients higher than 0.8 indicate multicollinearity

Assumptions Error Normality Normally distributed error term Errors cancel on average Error centered at 0 Homoscedasticity Errors have a constant variance over the full range of the dependent variable.

Normally Distributed Error Centered around Zero Histogram of residuals

Homoscedasticity Scatter plot of residuals and predicted values of dependent variable