Nonlinear models Hill et al Chapter 10. Types of nonlinear models Linear in the parameters. –Includes models that can be made linear by transformation:

Slides:



Advertisements
Similar presentations
The Simple Linear Regression Model Specification and Estimation Hill et al Chs 3 and 4.
Advertisements

Heteroskedasticity Hill et al Chapter 11. Predicting food expenditure Are we likely to be better at predicting food expenditure at: –low incomes; –high.
Reporting Results, and choosing a functional form. Hill et al chapter 6.
Chapter 4: Basic Estimation Techniques
CHAPTER 3: TWO VARIABLE REGRESSION MODEL: THE PROBLEM OF ESTIMATION
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Simple Linear Regression
Read Chapter 17 of the textbook
Multipe and non-linear regression. What is what? Regression: One variable is considered dependent on the other(s) Correlation: No variables are considered.
N-way ANOVA. 3-way ANOVA 2 H 0 : The mean respiratory rate is the same for all species H 0 : The mean respiratory rate is the same for all temperatures.
Chapter 3 Simple Regression. What is in this Chapter? This chapter starts with a linear regression model with one explanatory variable, and states the.
Curve-Fitting Regression
FIN357 Li1 Binary Dependent Variables Chapter 12 P(y = 1|x) = G(  0 + x  )
SIMPLE LINEAR REGRESSION
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
Standard Trend Models. Trend Curves Purposes of a Trend Curve: 1. Forecasting the long run 2. Estimating the growth rate.
Continuous Random Variables and Probability Distributions
Transforming the data Modified from: Gotelli and Allison Chapter 8; Sokal and Rohlf 2000 Chapter 13.
Classification and Prediction: Regression Analysis
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
9 - 1 Intrinsically Linear Regression Chapter Introduction In Chapter 7 we discussed some deviations from the assumptions of the regression model.
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
3.1 Ch. 3 Simple Linear Regression 1.To estimate relationships among economic variables, such as y = f(x) or c = f(i) 2.To test hypotheses about these.
Inference for regression - Simple linear regression
Correlation and Linear Regression
1 Experimental Statistics - week 10 Chapter 11: Linear Regression and Correlation.
MECN 3500 Inter - Bayamon Lecture 9 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
MTH 161: Introduction To Statistics
Curve-Fitting Regression
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Multiple Regression Petter Mostad Review: Simple linear regression We define a model where are independent (normally distributed) with equal.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.
ECON 338/ENVR 305 CLICKER QUESTIONS Statistics – Question Set #8 (from Chapter 10)
The Simple Linear Regression Model: Specification and Estimation ECON 4550 Econometrics Memorial University of Newfoundland Adapted from Vera Tabakova’s.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Review Normal Distributions –Draw a picture. –Convert to standard normal (if necessary) –Use the binomial tables to look up the value. –In the case of.
Chapter 1: Data and Linear Representations
Curve Fitting Introduction Least-Squares Regression Linear Regression Polynomial Regression Multiple Linear Regression Today’s class Numerical Methods.
1 Introduction to Modeling Beyond the Basics (Chapter 7)
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
More on data transformations No recipes, but some advice.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
Sampling and Sampling Distributions
The simple linear regression model and parameter estimation
Chapter 4: Basic Estimation Techniques
Chapter 4 Basic Estimation Techniques
Chapter 7. Classification and Prediction
Probability Theory and Parameter Estimation I
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
Basic Estimation Techniques
Non-linear relationships
Basic Estimation Techniques
Chapter 12 Inference on the Least-squares Regression Line; ANOVA
Linear Regression.
The Regression Model Suppose we wish to estimate the parameters of the following relationship: A common method is to choose parameters to minimise the.
The Simple Linear Regression Model
Linear regression Fitting a straight line to observations.
What is Regression Analysis?
Nonlinear regression.
The Simple Linear Regression Model: Specification and Estimation
Chapter 10 Nonlinear Models Undergraduated Econometrics Page 1
Nonlinear Fitting.
SIMPLE LINEAR REGRESSION
SIMPLE LINEAR REGRESSION
Presentation transcript:

Nonlinear models Hill et al Chapter 10

Types of nonlinear models Linear in the parameters. –Includes models that can be made linear by transformation: Nonlinear in the parameters –Require nonlinear least squares.

Polynomial terms in a regression For U-shaped curve we expect 2 0 U-shaped marginal cost curve 2 >0, 3 0

Interactions between continuous variables Is it reasonable that these effects are independent of income and age?

An alternative model

Empirical example

Nonlinear least squares Minimise sum of squared errors b = se(b) = Simple expressions for the value of beta that minimises S cannot be found. Similarly expressions for the se(beta) cannot be found. The problem is solved numerically.

A logistic growth curve

Example: proportion of steel produced with electric arc furnace

The poisson regression Number of visits to a lake: count data Does not have a normal distribution Poisson distribution is an alternative: is the average or mean number of visits per year, for all households Number of visits Frequency

Estimating the conditional mean function in the Poisson regression define the zero-mean error term

Computing probabilities in the Poisson regression What is the probability that a household located 50 miles from the Lake, with income of $60,000, and 3 family members, visits the park less than 3 times per year?