Simple Linear Regression

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Lesson 10: Linear Regression and Correlation
Kin 304 Regression Linear Regression Least Sum of Squares
Chapter 12 Simple Linear Regression
Forecasting Using the Simple Linear Regression Model and Correlation
BA 275 Quantitative Business Methods
Inference for Regression
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Simple Linear Regression. Start by exploring the data Construct a scatterplot  Does a linear relationship between variables exist?  Is the relationship.
Objectives (BPS chapter 24)
Simple Linear Regression
Introduction to Regression Analysis
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Chapter 10 Simple Regression.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
Linear Regression and Correlation
Stat 112 – Notes 3 Homework 1 is due at the beginning of class next Thursday.
SIMPLE LINEAR REGRESSION
Chapter Topics Types of Regression Models
Lecture 16 – Thurs, Oct. 30 Inference for Regression (Sections ): –Hypothesis Tests and Confidence Intervals for Intercept and Slope –Confidence.
SIMPLE LINEAR REGRESSION
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Pertemua 19 Regresi Linier
Multiple Regression Research Methods and Statistics.
Simple Linear Regression and Correlation
Chapter 7 Forecasting with Simple Regression
Copyright ©2006 Brooks/Cole, a division of Thomson Learning, Inc. More About Regression Chapter 14.
Simple Linear Regression Analysis
Correlation & Regression
Correlation and Regression
Introduction to Linear Regression and Correlation Analysis
Chapter 11 Simple Regression
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Regression Analysis. Scatter plots Regression analysis requires interval and ratio-level data. To see if your data fits the models of regression, it is.
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Chapter 4 Linear Regression 1. Introduction Managerial decisions are often based on the relationship between two or more variables. For example, after.
CORRELATION: Correlation analysis Correlation analysis is used to measure the strength of association (linear relationship) between two quantitative variables.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 16 Data Analysis: Testing for Associations.
Scatter Diagrams scatter plot scatter diagram A scatter plot is a graph that may be used to represent the relationship between two variables. Also referred.
28. Multiple regression The Practice of Statistics in the Life Sciences Second Edition.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
Chapter 11: Linear Regression and Correlation Regression analysis is a statistical tool that utilizes the relation between two or more quantitative variables.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Inference about the slope parameter and correlation
Regression Analysis.
Regression Analysis AGEC 784.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
AP Statistics Chapter 14 Section 1.
Virtual COMSATS Inferential Statistics Lecture-26
Kin 304 Regression Linear Regression Least Sum of Squares
Chapter 11: Simple Linear Regression
Regression Analysis.
BPK 304W Regression Linear Regression Least Sum of Squares
BPK 304W Correlation.
Correlation and Regression
CHAPTER 29: Multiple Regression*
Multiple Regression A curvilinear relationship between one variable and the values of two or more other independent variables. Y = intercept + (slope1.
LESSON 24: INFERENCES USING REGRESSION
6-1 Introduction To Empirical Models
BA 275 Quantitative Business Methods
Simple Linear Regression
Simple Linear Regression
SIMPLE LINEAR REGRESSION
Regression Part II.
Presentation transcript:

Simple Linear Regression

Regression Analysis Regression Analysis A statistical procedure used to develop an equation showing how two or more variables are related. Process: Taking an initial look at data to see if there is a relationship. Creating an equation to help us estimate/predict. Assessing whether equation fits the sample data. Use Statistical Inference to see if there is a significant relationship. Predict with the equation. Regression Analysis does not prove a cause and effect relationship.

Continue… Simple Regression Linear Regression Simple Linear Regression Regression analysis involving one independent variable (x) and one dependent variable (y). Linear Regression Regression analysis in which relationships between the independent variables and the dependent variable are approximated by a straight line. Simple Linear Regression Relationship between one independent variable and one dependent variable that is approximated by a straight line, with slope and intercept. Multiple Linear Regression Regression analysis involving two or more independent variables to create straight line model/equation. Curvilinear Relationships Relationships that are not linear.

Simple Liner Regression Model with Population Parameters Simple Linear Regression Model: y = β0 + β1x + ε y = Predicted value β1 = Slope x = Value you put into the equation to try and predict the y value. β0 = Y-Intercept ε = Error Value

Coefficient of Correlation (rxy) Measure the strength and direction of the linear relationship between two quantitative variables. Investigate if there is a relationship: We will have a number answer that indicates the strength and direction: Always a number between -1 and 1. 0 = No correlation Near 0.5 of -0.5 = moderate correlation Near -1 or 1 = strong correlation Note: Correlation DOES NOT imply causation

Coefficient of Determination ( 𝒓 𝟐 ) r^2 results in a number between 0 and 1. The closer to 1, the better the fit of the estimated equation to the X-Y sample data points. r^2 = 1 all X-Y sample markers fall on the estimated regression line. The proportion of the variability in the dependent variable (y) that is explained by the estimated regression equation/line.

Confidence Levels Confidence levels often used to indicate how the sample represents the population as a whole Confidence level – if you were to conduct the survey multiple times, how often you would expect to get similar results. Confidence interval – a range of means that you can be X% confident that it contains the true population mean.

Assumptions Regression function correctly specified (e.g. linear) Conditional distribution of Y is normal distribution Conditional distribution of Y has constant standard deviation Observation on Y are statistically independent Normality of the error distribution Constance variance of errors

Residuals = Particular Y value – Predicted Y Value Sometimes the Equation Underpredicts Sometimes the Equation Overpredicts