1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

AP Statistics Section 3.2 C Coefficient of Determination
Lecture 17: Tues., March 16 Inference for simple linear regression (Ch ) R2 statistic (Ch ) Association is not causation (Ch ) Next.
Topic 12: Multiple Linear Regression
Kin 304 Regression Linear Regression Least Sum of Squares
General Linear Model Introduction to ANOVA.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Simple Regression. Major Questions Given an economic model involving a relationship between two economic variables, how do we go about specifying the.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Ch11 Curve Fitting Dr. Deshi Ye
Definition  Regression Model  Regression Equation Y i =  0 +  1 X i ^ Given a collection of paired data, the regression equation algebraically describes.
Simple Linear Regression
Statistics for the Social Sciences
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Chapter 6 (cont.) Regression Estimation. Simple Linear Regression: review of least squares procedure 2.
Correlation & Regression
Regression and Correlation Methods Judy Zhong Ph.D.
Regression Analysis What is regression ?What is regression ? Best-fit lineBest-fit line Least squareLeast square What is regression ?What is regression.
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
MTH 161: Introduction To Statistics
Multivariate Analysis. One-way ANOVA Tests the difference in the means of 2 or more nominal groups Tests the difference in the means of 2 or more nominal.
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
Chapter 14 Inference for Regression AP Statistics 14.1 – Inference about the Model 14.2 – Predictions and Conditions.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Regression Regression relationship = trend + scatter
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
Chapter 13 Multiple Regression
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Chapter 10: Determining How Costs Behave 1 Horngren 13e.
Linear Prediction Correlation can be used to make predictions – Values on X can be used to predict values on Y – Stronger relationships between X and Y.
Stat 112 Notes 6 Today: –Chapter 4.1 (Introduction to Multiple Regression)
Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)
Chapter 11: Linear Regression and Correlation Regression analysis is a statistical tool that utilizes the relation between two or more quantitative variables.
Curve Fitting Introduction Least-Squares Regression Linear Regression Polynomial Regression Multiple Linear Regression Today’s class Numerical Methods.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Statistics 350 Review. Today Today: Review Simple Linear Regression Simple linear regression model: Y i =  for i=1,2,…,n Distribution of errors.
Introduction. We want to see if there is any relationship between the results on exams and the amount of hours used for studies. Person ABCDEFGHIJ Hours/
Simple linear regression. What is simple linear regression? A way of evaluating the relationship between two continuous variables. One variable is regarded.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
STA302/1001 week 11 Regression Models - Introduction In regression models, two types of variables that are studied:  A dependent variable, Y, also called.
The simple linear regression model and parameter estimation
Chapter 11: Linear Regression and Correlation
Regression and Correlation of Data Summary
Chapter 4 Basic Estimation Techniques
Regression Analysis AGEC 784.
LEAST – SQUARES REGRESSION
AP Statistics Chapter 14 Section 1.
Kin 304 Regression Linear Regression Least Sum of Squares
Ch12.1 Simple Linear Regression
BPK 304W Regression Linear Regression Least Sum of Squares
Simple Linear Regression - Introduction
Probability and Statistics for Computer Scientists Second Edition, By: Michael Baron Section 11.1: Least squares estimation CIS Computational.
CHAPTER 29: Multiple Regression*
Linear Regression.
LESSON 23: MULTIPLE REGRESSION
Simple Linear Regression
Regression Models - Introduction
M248: Analyzing data Block D UNIT D2 Regression.
Simple Linear Regression
Chapter 14 Inference for Regression
Algebra Review The equation of a straight line y = mx + b
Regression and Correlation of Data
Introduction to Regression
Regression and Correlation of Data
Regression Models - Introduction
Presentation transcript:

1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k

2 Simple Linear Regression

3

4 Multiple Regression

5

6 Conditions The random error term,, is Independent Identically distributed Normally distributed with standard deviation,.

7 Example Y, Response – Effectiveness score based on experienced teachers’ evaluations. Explanatory – Test 1, Test 2, Test 3, Test 4.

8

9

10

11

12 Individual Tests None of the individual tests (explanatory variables) appears to be strongly related to the evaluation (response variable).

13 Method of Least Squares Choose estimates of the various parameters in the multiple regression model so that the sum of squared residuals, (SS Error ), is the smallest it can be.

14 Method of Least Squares Finding the estimates involves solving k+1 simultaneous equations with k+1 unknowns (the estimates of the parameters). Do this with a statistical analysis computer package, like JMP.

15 JMP Analyze – Fit Model Pick Role Variables Y – EVAL Construct Model Effects Add – Test1, Test2, Test3, Test4

16 JMP Analyze – Fit Model Personality – Standard Least Squares Emphasis – Minimal Report

17

18 Prediction Equation Predicted Evaluation = – *Test *Test2 – 1.367*Test *Test4