Notes on Weighted Least Squares Straight line Fit Passing Through The Origin Amarjeet Bhullar November 14, 2008.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Data Modeling and Least Squares Fitting COS 323. Data Modeling Given: data points, functional form, find constants in functionGiven: data points, functional.
Linear Equations Review. Find the slope and y intercept: y + x = -1.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
1 Simple Linear Regression and Correlation The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES Assessing the model –T-tests –R-square.
P M V Subbarao Professor Mechanical Engineering Department
Read Chapter 17 of the textbook
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Bimonthly Meeting on September 12, 2008 Uncertainty in Transcription of Lesion Contours to Diffusion Weighted Magnetic Resonance Images Amarjeet Bhullar.
GG 313 Geological Data Analysis # 18 On Kilo Moana at sea October 25, 2005 Orthogonal Regression: Major axis and RMA Regression.
Curve-Fitting Regression
Linear fits You know how to use the solver to minimize the chi^2 to do linear fits… Where do the errors on the slope and intercept come from?
PSY 1950 General Linear Model November 12, The General Linear Model Or, What the Hell ’ s Going on During Estimation?
Week Lecture 3Slide #1 Minimizing e 2 : Deriving OLS Estimators The problem Deriving b 0 Deriving b 1 Interpreting b 0 and b 1.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. by Lale Yurttas, Texas A&M University Chapter 171 CURVE.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. by Lale Yurttas, Texas A&M University Chapter 171 Least.
1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Least-Squares Regression
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Simple Linear Regression. Types of Regression Model Regression Models Simple (1 variable) LinearNon-Linear Multiple (2
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
Geo479/579: Geostatistics Ch12. Ordinary Kriging (1)
R. Kass/W03P416/Lecture 7 1 Lecture 7 Some Advanced Topics using Propagation of Errors and Least Squares Fitting Error on the mean (review from Lecture.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
1 Dr. Jerrell T. Stracener EMIS 7370 STAT 5340 Probability and Statistics for Scientists and Engineers Department of Engineering Management, Information.
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
MECN 3500 Inter - Bayamon Lecture 9 Numerical Methods for Engineering MECN 3500 Professor: Dr. Omar E. Meza Castillo
Statistical Methods Statistical Methods Descriptive Inferential
Curve-Fitting Regression
Regression. Population Covariance and Correlation.
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
2014. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR We need to be.
Summary Part 1 Measured Value = True Value + Errors = True Value + Errors Errors = Random Errors + Systematic Errors How to minimize RE and SE: (a)RE –
Chapter 6 (cont.) Difference Estimation. Recall the Regression Estimation Procedure 2.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
The chi-squared statistic  2 N Measures “goodness of fit” Used for model fitting and hypothesis testing e.g. fitting a function C(p 1,p 2,...p M ; x)
Curve Fitting Pertemuan 10 Matakuliah: S0262-Analisis Numerik Tahun: 2010.
Chapter 3- Model Fitting. Three Tasks When Analyzing Data: 1.Fit a model type to the data. 2.Choose the most appropriate model from the ones that have.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 7: Regression.
The General Linear Model. Estimation -- The General Linear Model Formula for a straight line y = b 0 + b 1 x x y.
OLS Regression What is it? Closely allied with correlation – interested in the strength of the linear relationship between two variables One variable is.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
R. Kass/Sp07P416/Lecture 71 More on Least Squares Fit (LSQF) In Lec 5, we discussed how we can fit our data points to a linear function (straight line)
The simple linear regression model and parameter estimation
Notes on Weighted Least Squares Straight line Fit Passing Through The Origin Amarjeet Bhullar November 14, 2008.
Part 5 - Chapter
Part 5 - Chapter 17.
Linear Regression Special Topics.
Projection on Latent Variables
Ch3: Model Building through Regression
Linear Regression Bonus
Ordinary Least Squares (OLS) Regression
Multiple Regression.
Linear Functions.
Simple Linear Regression - Introduction
Part 5 - Chapter 17.
Linear regression Fitting a straight line to observations.
مدلسازي تجربي – تخمين پارامتر
M248: Analyzing data Block D UNIT D2 Regression.
Least-Squares Regression
Discrete Least Squares Approximation
Point-slope Form of Equations of Straight Lines
Multivariate Analysis Regression
Model Direct Variation
Presentation transcript:

Notes on Weighted Least Squares Straight line Fit Passing Through The Origin Amarjeet Bhullar November 14, 2008

Data Set For given {x i, y i } find line through them; i.e., find a and b in y = a+bxFor given {x i, y i } find line through them; i.e., find a and b in y = a+bx (x 1,y 1 ) (x 2,y 2 ) (x 3,y 3 ) (x 4,y 4 ) (x 5,y 5 ) (x 6,y 6 ) (x 7,y 7 )

Least Squares Universal formulation of fitting: minimize squares of differences between data and functionUniversal formulation of fitting: minimize squares of differences between data and function – Example: for fitting a line, minimize Using appropriate a and b – General solution: take derivatives w.r.t. unknown variables, set equal to zero

Linear Least Squares: Equal Weighting

Data Reduction and Error Analysis for the Physical Sciences by Philip R Bevington (1969)

Uncertainties or Estimation of Errors: In a & b Using the propagation of errors:Using the propagation of errors:

Uncertainty or Estimation of Error: In Calculated a The uncertainty in parameter a

Uncertainty or Estimation of Error: In Calculated b The uncertainty in parameter b

Uncertainties or Estimation of Errors: In Calculated a & b Intercept Uncertainty or Error Slope Uncertainty or Error Where &

Linear Least Squares fit : Linear least squares fitting and error of a straight line which MUST go through the origin (0, 0).Linear least squares fitting and error of a straight line which MUST go through the origin (0, 0). Partial derivative w. r. t. b is zeroPartial derivative w. r. t. b is zero

Uncertainty or Estimation of Error in b Where

Weighted Least Squares Straight Line Fitting

Uncertainties in a and b: Unequal Weighting Intercept Uncertainty or Error Slope Uncertainty or Error Where

Weighted Least Squares Straight Line Fit: Eq (6) in draft should be Where Eq (7) in draft should be

Uncertainty in b: Unequal Weighting Eq (8) in draft should be

Conclusion Eq (6) Eq (7) Eq (8)