Presentation is loading. Please wait.

Presentation is loading. Please wait.

Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)

Similar presentations


Presentation on theme: "Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)"— Presentation transcript:

1 Math 4030 – 11b Method of Least Squares

2 Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated) values of the coefficients  and  (based on the sample data) Evaluate the model efficiency; Predict or estimate the Y values for “un-tested” x values. XY x1x1 y1y1 x2x2 y2y2 …… xnxn ynyn Raw data:

3 Regression Line (Best Fitting Line) Estimated Y value for given x Estimated coefficients for  and  Error Finding the equation of the best fitting line is to find the coefficients a and b, the estimated values of  and . How?

4 The Method of Least Squares Method of Least Squares finds the line (or a and b) such that sum of squared errors is minimized (among all choices of a and b.

5 Calculation: Solve a system of 2 linear equations.

6 Solution by Cramer’s Rule:

7 Square-Sum Notations:

8 Solutions: Estimate  : Estimate  : Equation for the Regression Line: Residual sum of squares (or error sum of squares): Note: exchange x and y will end in different regression line.

9 Curvilinear Regression (Sec. 11.3): Exponential: Reciprocal: Power:

10 Objectives: Find (estimated) values of the coefficients  i ‘s (based on the sample data) Predict or estimate the Y values for “un-tested” x values. XY x1x1 y1y1 x2x2 y2y2 …… xnxn ynyn Raw data: Polynomial Regression:

11 Calculation: Solve a system of p + 1 linear equations to solve p + 1 unknowns. If all x i values are distinct, the system has the unique solution.


Download ppt "Math 4030 – 11b Method of Least Squares. Model: Dependent (response) Variable Independent (control) Variable Random Error Objectives: Find (estimated)"

Similar presentations


Ads by Google