Theory and Estimation of Regression Models Simple Regression Theory

Slides:



Advertisements
Similar presentations
The Simple Linear Regression Model Specification and Estimation Hill et al Chs 3 and 4.
Advertisements

Properties of Least Squares Regression Coefficients
Multiple Regression Analysis
Kin 304 Regression Linear Regression Least Sum of Squares
The Simple Regression Model
CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION
Chapter 12 Simple Linear Regression
Statistical Techniques I EXST7005 Simple Linear Regression.
1 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH UJI HIPOTESIS SUMBER:
Regresi Linear Sederhana Pertemuan 01 Matakuliah: I0174 – Analisis Regresi Tahun: Ganjil 2007/2008.
Regresi dan Korelasi Linear Pertemuan 19
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Chapter 10 Simple Regression.
9. SIMPLE LINEAR REGESSION AND CORRELATION
Simple Linear Regression
Chapter 13 Introduction to Linear Regression and Correlation Analysis
The Simple Regression Model
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 13 Introduction to Linear Regression and Correlation Analysis.
Linear Regression and Correlation Analysis
1 MF-852 Financial Econometrics Lecture 6 Linear Regression I Roy J. Epstein Fall 2003.
Chapter 13 Introduction to Linear Regression and Correlation Analysis
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
FIN357 Li1 The Simple Regression Model y =  0 +  1 x + u.
Correlation and Regression Analysis
Ordinary Least Squares
Introduction to Linear Regression and Correlation Analysis
Chapter 11 Simple Regression
MAT 254 – Probability and Statistics Sections 1,2 & Spring.
Chapter 6 & 7 Linear Regression & Correlation
Regression. Idea behind Regression Y X We have a scatter of points, and we want to find the line that best fits that scatter.
7.1 Multiple Regression More than one explanatory/independent variable This makes a slight change to the interpretation of the coefficients This changes.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Introduction to Linear Regression
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
MTH 161: Introduction To Statistics
Applied Quantitative Analysis and Practices LECTURE#23 By Dr. Osman Sadiq Paracha.
1Spring 02 First Derivatives x y x y x y dy/dx = 0 dy/dx > 0dy/dx < 0.
Roger B. Hammer Assistant Professor Department of Sociology Oregon State University Conducting Social Research Ordinary Least Squares Regression.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 13-1 Introduction to Regression Analysis Regression analysis is used.
Chapter 10 For Explaining Psychological Statistics, 4th ed. by B. Cohen 1 A perfect correlation implies the ability to predict one score from another perfectly.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Chapters 8 Linear Regression. Correlation and Regression Correlation = linear relationship between two variables. Summarize relationship with line. Called.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Chapter 12 Simple Regression Statistika.  Analisis regresi adalah analisis hubungan linear antar 2 variabel random yang mempunyai hub linear,  Variabel.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Slides by JOHN LOUCKS St. Edward’s University.
Bivariate Regression. Bivariate Regression analyzes the relationship between two variables. Bivariate Regression analyzes the relationship between two.
Chapter 13 Simple Linear Regression
The simple linear regression model and parameter estimation
Linear Regression with One Regression
Linear Regression and Correlation Analysis
Chapter 3: TWO-VARIABLE REGRESSION MODEL: The problem of Estimation
Quantitative Methods Simple Regression.
Two-Variable Regression Model: The Problem of Estimation
Linear Regression.
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
Linear regression Fitting a straight line to observations.
Simple Linear Regression
Simple Linear Regression
Linear Regression Summer School IFPRI
Ch3 The Two-Variable Regression Model
Regression Models - Introduction
Presentation transcript:

Theory and Estimation of Regression Models Simple Regression Theory Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Population Line: E[Y] = B0+B1X Yi = E[Yi]+ui ui E[Yi] = B0+B1Xi Xi Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Population Line: E[Y] = B0+B1X ^ Yi = Yi + ei Estimated Line: ^ ^ ^ ui ^ ^ ^ Yi = B0+B1Xi E[Yi] Xi Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

^ ^ ^ Y = B0+B1X ei ei ei ei ei ei Xi Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Metode Ordinary Least Squares (OLS) In the Ordinary Least Squares (OLS) method, the criterion for estimating β0 and β1 is to make the sum of the squared residuals (SSR) of the fitted regression line as small as possible i.e.: Minimize SSR = minimize = minimize Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Metode Ordinary Least Squares (OLS) Rumus estimator OLS : (5.12) (5.13) Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Metode Ordinary Least Squares (OLS) Garis regresi yang diestimasi dengan menggunakan metode OLS mempunyhai ciri-ciri : (i.e. the sum of its residuals is zero) It always passes through the point The residual values (ei’s) are not correlated with the values of the independent variable (Xi’s) Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Interpretasi Model Regresi Assume, for example, that the estimated or fitted regression equation is: or Yi = 3.7 + 0.15Xi + ei Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Sumber: www. aaec. ttu. edu/faculty/omurova/aaec_4302/. /Chapter%205 Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Interpretasi Model Regresi Yi = 3.7 + 0.15Xi + ei The value of = 0.15 indicates that if the average cotton price received by farmers in the previous year increases by 1 cent/pound (i.e. X=1), then this year’s cotton acreage is predicted to increase by 0.15 million acres (150,000 acres). Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Interpretasi Model Regresi Yi = 3.7 + 0.15Xi + ei The value of = 3.7 indicates that if the average cotton price received by farmers in the previous year was zero (i.e. =0), the cotton acreage planted this year will be 3.7 million (3,700,000) acres; sometimes the intercept makes no practical sense. Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Mengukur Goodness of Fit: R2 There are two statistics (formulas) that quantify how well the estimated regression line fits the data: The standard error of the regression (SER) (Sometimes called the standard error of the estimate) R2 - coefficient of determination Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Mengukur Goodness of Fit: R2 SER agak berbeda dengan simpangan-baku (standard deviasi S) ei (oleh derajat bebasnya): (5.20) Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Mengukur Goodness of Fit: R2 The term on the left measures the proportion of the total variation in Y not explained by the model (i.e. by X) R2 mengukur proporsi dari total ragam Y yang dapat dijelaskan oleh model (yaitu dijelaskan oleh X) Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Sifat-sifat Estimator OLS The Gauss-Markov Theorem states the properties of the OLS estimators; i.e. of the: and They are unbiased E[B0 ]= and E[B1]= Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Sifat-sifat Estimator OLS If the dependent variable Y (and thus the error term of the population regression model, ui) has a normal distribution, the OLS estimators have the minimum variance Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎

Sifat-sifat Estimator OLS BLUE – Best Linear Unbiased Estimator Unbiased => bias of βj = E(βj ) - βj = 0 Best Unbiased => minimum variance & unbiased Linear => the estimator is linear ^ ^ Sumber: www.aaec.ttu.edu/faculty/omurova/aaec_4302/.../Chapter%205.ppt‎