Ordinary least Squares

Slides:



Advertisements
Similar presentations
Econometric Modelling
Advertisements

Cointegration and Error Correction Models
Multiple Regression.
F-tests continued.
Regression Analysis.
Chapter 4: Basic Estimation Techniques
Managerial Economics in a Global Economy
Chap 12-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 12 Simple Regression Statistics for Business and Economics 6.
Forecasting Using the Simple Linear Regression Model and Correlation
Correlation and regression Dr. Ghada Abo-Zaid
Objectives (BPS chapter 24)
Chapter 12 Simple Linear Regression
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
Copyright © 2008 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics, 9e Managerial Economics Thomas Maurice.
Chapter 12 Simple Regression
Simple Linear Regression
The Simple Regression Model
Fall 2006 – Fundamentals of Business Statistics 1 Chapter 13 Introduction to Linear Regression and Correlation Analysis.
Pengujian Parameter Koefisien Korelasi Pertemuan 04 Matakuliah: I0174 – Analisis Regresi Tahun: Ganjil 2007/2008.
Chapter Topics Types of Regression Models
Linear Regression and Correlation Analysis
1 Simple Linear Regression and Correlation Chapter 17.
Ch. 14: The Multiple Regression Model building
© 2000 Prentice-Hall, Inc. Chap Forecasting Using the Simple Linear Regression Model and Correlation.
Correlation and Regression Analysis
Introduction to Regression Analysis, Chapter 13,
Lecture 5 Correlation and Regression
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Simple Linear Regression Analysis Chapter 13.
Regression and Correlation Methods Judy Zhong Ph.D.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
1 Least squares procedure Inference for least squares lines Simple Linear Regression.
OPIM 303-Lecture #8 Jose M. Cruz Assistant Professor.
Statistics for Business and Economics 7 th Edition Chapter 11 Simple Regression Copyright © 2010 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
© 2003 Prentice-Hall, Inc.Chap 13-1 Basic Business Statistics (9 th Edition) Chapter 13 Simple Linear Regression.
Introduction to Linear Regression
Statistical Methods Statistical Methods Descriptive Inferential
1 Chapter 12 Simple Linear Regression. 2 Chapter Outline  Simple Linear Regression Model  Least Squares Method  Coefficient of Determination  Model.
Copyright © 2005 by the McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Managerial Economics Thomas Maurice eighth edition Chapter 4.
Y X 0 X and Y are not perfectly correlated. However, there is on average a positive relationship between Y and X X1X1 X2X2.
CHAPTER 5 Regression BPS - 5TH ED.CHAPTER 5 1. PREDICTION VIA REGRESSION LINE NUMBER OF NEW BIRDS AND PERCENT RETURNING BPS - 5TH ED.CHAPTER 5 2.
Correlation & Regression Analysis
11 Chapter 5 The Research Process – Hypothesis Development – (Stage 4 in Research Process) © 2009 John Wiley & Sons Ltd.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Chapter 12 Simple Linear Regression n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n Testing.
Lecturer: Ing. Martina Hanová, PhD.. Regression analysis Regression analysis is a tool for analyzing relationships between financial variables:  Identify.
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
The simple linear regression model and parameter estimation
F-tests continued.
Chapter 4: Basic Estimation Techniques
Chapter 4 Basic Estimation Techniques
Statistics for Managers using Microsoft Excel 3rd Edition
Correlation and Simple Linear Regression
Basic Estimation Techniques
Chow test.
Chapter 11 Simple Regression
Correlation and Simple Linear Regression
Basic Estimation Techniques
CHAPTER 29: Multiple Regression*
Correlation and Simple Linear Regression
Chapter 3 Statistical Concepts.
Simple Linear Regression and Correlation
Chapter 7: The Normality Assumption and Inference with OLS
Seminar in Economics Econ. 470
Product moment correlation
Introduction to Regression
Correlation and Simple Linear Regression
Correlation and Simple Linear Regression
Presentation transcript:

Ordinary least Squares

Introduction Describe the nature of financial data. Assess the concepts underlying regressions analysis Describe some examples of financial models. Examine the Ordinary least Squares (OLS) technique and hypothesis testing

Financial data The data can be high frequency, i.e. daily or even every minute. i.e. Stock market prices are measured every time there is a trade or somebody posts a new quote. The data is usually good quality Recorded asset prices are usually those at which the transaction took place. Little possibility for measurement error.  

Financial Data Financial Data is affected by risk. Most financial data is affected by not just return but also risk, which requires specialist modelling. Financial data is ‘noisy’ It is often difficult to pick up patterns in the data due to the variable nature of financial data.

Time Series data Examples of Problems that Could be Tackled Using a Time Series Regression - How the value of a country’s stock index has varied with that country’s macroeconomic fundamentals. - How the value of a company’s stock price has varied when it announced the value of its dividend payment. - The effect on a country’s currency of an increase in its interest rate

Cross-Sectional data Cross-sectional data are data on one or more variables collected at a single point in time, e.g. - A poll of usage of internet stock broking services - Cross-section of stock returns on the New York Stock Exchange - A sample of bond credit ratings for UK banks

Model Estimation Economic or Financial Theory (Previous Studies) Formulation of an Estimable Theoretical Model Collection of Data Model Estimation Is the Model Statistically Adequate? No Yes Reformulate Model Interpret Model Use for Analysis

Financial Data MI i 18 3 21 4 20 23 25 6 27 26 28 5 30 32

Regression

Econometric Model

Estimates

The Residual Term (Also called the error term and disturbance term) It describes the random component of the regression. It is caused by: - Omission of explanatory variables - The aggregation of the variables - Mis-specification of the model - Incorrect functional form of the model - Measurement error

Least Squares Approach The aim of this approach is to minimize the residual for all residuals We square the residual before minimizing We can then derive our intercept and slope parameter using basic calculus

Regression Regression is the degree of dependency of the dependent variable on the explanatory variables Correlation measures the strength of a linear association between two variables Causation suggests the dependent variable depends on previous values of the explanatory variable Regression does not imply causaltion

R-Squared Statistic This statistic explains the proportion of total variation in the dependent variable which is explained by the regression The statistic explains the explanatory power of the regression and measures how good a fit the data is. The value of this statistic lies between 0 and 1(when all the scatter plots lie on the regression line.)

Interpretation of Results Consider the type of model being estimated What are the units of measurement of the variables (unless all the variables are in logarithmic form) The range of observations The signs of the variables, does it accord with the theoretical model Are the magnitudes of the parameters plausible We need to remember it is only a model, the parameters are estimates, so it describes average values, individual cases may vary

Significance Testing

Hypotheses Test

Hypothesis Testing Test the significance of the constant term in the same way as the slope parameter Although the conventional test for significance is at the 5% level, we also test at the 1% and 10% levels Use of the t-distribution tells us what to expect ‘by chance’ For finite samples, when applying the t-test, we need to allow for degrees of freedom The t-test can be applied to either one or two tailed tests The t-test is an absolute value, so we can ignore the sign

The T-test If the t-test statistic exceeds the critical value, reject the null hypothesis, if we are testing if the coefficient equals zero, this means it is significant If the test statistic is below the critical value accept the null hypothesis. To find the critical value, you need to know the degrees of freedom, which equal n-k-1.

Conclusion Financial data tends to be more plentiful and of better quality than other data. Regression analysis involves fitting a line to a scatter diagram The error term describes the random component of the regression Ordinary Least Squares (OLS) involves minimizing the sum of the square of the residuals