Physics 310 The Method of Maximum Likelihood as applied to a linear function What is the appropriate condition to be satisfied for the sample population.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Chapter 7 Statistical Data Treatment and Evaluation
Estimation  Samples are collected to estimate characteristics of the population of particular interest. Parameter – numerical characteristic of the population.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Chapter 6: Exploring Data: Relationships Lesson Plan
Regression Analysis Using Excel. Econometrics Econometrics is simply the statistical analysis of economic phenomena Here, we just summarize some of the.
© 2010 Pearson Prentice Hall. All rights reserved Least Squares Regression Models.
SIMPLE LINEAR REGRESSION
EART20170 Computing, Data Analysis & Communication skills
Lecture 5 Curve fitting by iterative approaches MARINE QB III MARINE QB III Modelling Aquatic Rates In Natural Ecosystems BIOL471 © 2001 School of Biological.
SIMPLE LINEAR REGRESSION
Chi Square Distribution (c2) and Least Squares Fitting
CHAPTER 3 Describing Relationships
1 Chapter 17: Introduction to Regression. 2 Introduction to Linear Regression The Pearson correlation measures the degree to which a set of data points.
Simple Linear Regression and Correlation
Introduction to Regression Analysis, Chapter 13,
Least Squares Regression Line (LSRL)
1 Chapter 10 Correlation and Regression We deal with two variables, x and y. Main goal: Investigate how x and y are related, or correlated; how much they.
Thinking Mathematically Algebra: Graphs, Functions and Linear Systems 7.3 Systems of Linear Equations In Two Variables.
SIMPLE LINEAR REGRESSION
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Copyright © Cengage Learning. All rights reserved. 13 Linear Correlation and Regression Analysis.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 11-1 Chapter 11 Chi-Square Tests Business Statistics, A First Course 4 th Edition.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Section 10-1 Review and Preview.
Probabilistic and Statistical Techniques 1 Lecture 24 Eng. Ismail Zakaria El Daour 2010.
Inferences in Regression and Correlation Analysis Ayona Chatterjee Spring 2008 Math 4803/5803.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved Lecture Slides Elementary Statistics Eleventh Edition and the Triola.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
Section 9-1: Inference for Slope and Correlation Section 9-3: Confidence and Prediction Intervals Visit the Maths Study Centre.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 11-1 Chapter 11 Chi-Square Tests Business Statistics: A First Course Fifth Edition.
LECTURE 3: ANALYSIS OF EXPERIMENTAL DATA
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 3 Describing Relationships 3.2 Least-Squares.
Linear Equation: an equation whose graph forms a line. is linear. is not. In linear equations, all variables are taken to the first power. Linear means.
Probability Distribution of a Discrete Random Variable If we have a sample probability distribution, we use (x bar) and s, respectively, for the mean.
Hypothesis test flow chart frequency data Measurement scale number of variables 1 basic χ 2 test (19.5) Table I χ 2 test for independence (19.9) Table.
IE241: Introduction to Design of Experiments. Last term we talked about testing the difference between two independent means. For means from a normal.
Chapter 7: The Distribution of Sample Means. Frequency of Scores Scores Frequency.
Copyright (C) 2002 Houghton Mifflin Company. All rights reserved. 1 Understandable Statistics Seventh Edition By Brase and Brase Prepared by: Lynn Smith.
Key Concepts for Sect. 7.1 *A system of equations is two or more equations in two or more variables. *Numerically, a solution to a system of equations.
CHAPTER 4 ESTIMATES OF MEAN AND ERRORS. 4.1 METHOD OF LEAST SQUARES I n Chapter 2 we defined the mean  of the parent distribution and noted that the.
WELCOME TO THE PRESENTATION ON LINEAR REGRESSION ANALYSIS & CORRELATION (BI-VARIATE) ANALYSIS.
Richard Kass/F02P416 Lecture 6 1 Lecture 6 Chi Square Distribution (  2 ) and Least Squares Fitting Chi Square Distribution (  2 ) (See Taylor Ch 8,
MathematicalMarketing Slide 3c.1 Mathematical Tools Chapter 3: Part c – Parameter Estimation We will be discussing  Nonlinear Parameter Estimation  Maximum.
Regression and Correlation
Physics 114: Lecture 13 Probability Tests & Linear Fitting
10.2 Regression If the value of the correlation coefficient is significant, the next step is to determine the equation of the regression line which is.
Chapter 11 Chi-Square Tests.
Ch3: Model Building through Regression
SIMPLE LINEAR REGRESSION MODEL
The Least-Squares Regression Line
Lecture Slides Elementary Statistics Thirteenth Edition
Correlation and Regression
Chapter 10 Correlation and Regression
Chi Square Distribution (c2) and Least Squares Fitting
POINT ESTIMATOR OF PARAMETERS
The Simple Linear Regression Model: Specification and Estimation
Chapter 11 Chi-Square Tests.
Chapter 7: The Distribution of Sample Means
CHAPTER 3 Describing Relationships
SIMPLE LINEAR REGRESSION
Objectives Identify solutions of linear equations in two variables.
5.1 Solving Systems of Equations by Graphing
Lecture # 2 MATHEMATICAL STATISTICS
Facts from figures Having obtained the results of an investigation, a scientist is faced with the prospect of trying to interpret them. In some cases the.
Geology Geomath Chapter 7 - Statistics tom.h.wilson
Solutions of Linear Functions
Chapter 11 Chi-Square Tests.
Presentation transcript:

Physics 310 The Method of Maximum Likelihood as applied to a linear function What is the appropriate condition to be satisfied for the sample population to best represent the parent population?

Physics 310 The parent population...  Suppose we have data which we comes from a parent population characterized by a linear relationship betwen x and y:  Suppose we have (x,y) data which we assume comes from a parent population characterized by a linear relationship betwen x and y:   y = a + bx  The problem: What is the best way to find the value of and which most likely represent the parent population from which our sample is obtained?  The problem: What is the best way to find the value of a and b which most likely represent the parent population from which our sample is obtained?

Physics 310 Why do we assume it is linear?  Suppose you have a table of data in two columns. What is the obvious next thing to do?  Suppose you have a table of (x,y) data in two columns. What is the obvious next thing to do?  Make a graph of vs and examine the apparant relationship between these pairs of measured values.  Make a graph of y vs x and examine the apparant relationship between these pairs of measured values.  Then, estimate the likely relationship -- i.e., “guess” the parent population!

Physics 310 Our goal...  If we assume the relationship between appears to be a linear one, our goal then is to find and  If we assume the relationship between (x,y) appears to be a linear one, our goal then is to find a and b  We will use the method of maximum likelihood -- as before, but now we determine two values, not just one.  The mathematical formalism is the same; the complexity is a bit greater!

Physics 310 Probability for one point -- Probability for one (x i,y i ) point --  The probability of making a measurement when there is an uncertainty in which isis just --  The probability of making a measurement (x i,y i ) when there is an uncertainty in y i which is  i is just --

Physics 310 The probability for all our points  The probability of getting our entire set of points is then --

Physics 310 To maximize the probability --  We must minimize to maximize the probability  We must minimize  2 to maximize the probability  This implies we minimize the squared deviations,  i.e., find the least squared deviations

Physics 310 Minimize with respect to...? Minimize  2 with respect to...?  In chaper 4, we minimized with respect to the trial mean,  In chaper 4, we minimized with respect to the trial mean,  ’  Here we minimize with respect to and simultaneously --  Here we minimize with respect to a and b simultaneously --  These lead to equations (6.10) and (6.11) - whose solutions are seen as (6.12)

Physics which give us and....which give us a and b.  Remember and are found such as to maximize the probability that these values of and will represent the parent population and from which our data came. This implies for each.  Remember a and b are found such as to maximize the probability that these values of a and b will represent the parent population a o and b o from which our data came. This implies for each x i. » Parent Population » Our data

Physics 310 Uncertainties and ? Uncertainties  a and  b ?  We estimate the uncertainties in and just as we did in chapter 4:  We estimate the uncertainties in a and b just as we did in chapter 4: – leading to equations (6.20) and (6.21).

Physics 310 Set up spreadsheet -- ,,,,,...  Then form columns of quotients  Sum the columns  Substitute in the equations to get the values of and, and and.  Substitute in the equations to get the values of a and b, and  a and  b.  Quote results as where  Quote results as y = a+ bx where a = MeV 0.04 MeV b = 23.6 MeV/ch 0.2 MeV/ch

Physics 310 We define as -- We define  2 as --  Calculate the individual for each point  Then sum to get the total  Then sum to get the total  2

Physics 310 What do we expect for ? What do we expect for  2 ?  Imagine that, on average, the deviations (numerator) were ~.  Imagine that, on average, the deviations (numerator) were ~ 1 .  Then, the sum of the ratio for datum points would be ~ !  Then, the sum of the ratio for N (x i,y i ) datum points would be ~ N!  Statistically, we expect for the value  Statistically, we expect for  2 the value

Physics 310 Conclusions...  What do you conclude if is ~1?  What do you conclude if is >>1?  What do you conclude if is <<1?  What do you do if one point has a very large value of ?  What do you do if one point has a very large value of  2 ?