Presentation is loading. Please wait.

Presentation is loading. Please wait.

Estimating the accuracy of the approximation (surrogate) From assumption that error is due to normally distributed uncorrelated random variables, get.

Similar presentations


Presentation on theme: "Estimating the accuracy of the approximation (surrogate) From assumption that error is due to normally distributed uncorrelated random variables, get."— Presentation transcript:

1

2 Estimating the accuracy of the approximation (surrogate) From assumption that error is due to normally distributed uncorrelated random variables, get estimate to error standard deviation (called standard error) Standard measure of accuracy Coefficient of multiple determination measures how much of variability in data is captured by approximation Adjusted coefficient of multiple determination accounts for the fitting bias

3 Curve fit noise=randn(1,30); x=1:1:30; y=x+noise ………………………………… [p,s]=polyfit(x,y,1); yfit=polyval(p,x); plot(x,y,'+',x,x,'r',x,yfit,'b') With dense data, functional form is clear. Fit serves to filter out noise

4 Example with y=0.1*x noise=randn(1,30); x=1:1:30; y=0.1*x+noise ; xx=[ones(30,1),x']; [B,BINT,R,RINT,STATS] = regress(y',xx) Stat

5 Estimating error in coefficients Some coefficients are more accurately estimated than others Standard error in coefficient is t-statistic is ratio of coefficient to standard error, would like it to be at least 2 Coefficients that are poorly estimated may be dropped to improve accuracy of predictions Dropping one coefficients changes t-statistics for others Need to iterate in dropping and adding coefficients

6 Regression in Excel (add-in data analysis) Rand Rand-0.5 x y fit error

7 Regression output SUMMARY OUTPUT Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations30 CoefficientsStandard Errort StatP-valueLower 95%Upper 95% Intercept X Variable E

8 Output with y=0.1x SUMMARY OUTPUT Regression Statistics Multiple R R Square Adjusted R Square Standard Error Observations30 Coefficients Standard Errort StatP-valueLower 95%Upper 95% Intercept X Variable E

9 Example Given data Use Microsoft Excel to fit linear and quadratic polynomials Compare standard errors and t-statistics of coefficients X-2012 Y

10 Linear fit

11 Quadratic fit

12 Graphical comparison.

13 Cross validation Error estimates based on model assumptions are vulnerable For polynomial response surface approximations assumptions are rarely satisfied Cross validation divides data into n g groups Fit the approximation to n g -1 groups, and use last group to estimate error. Repeat for each group When each group consists of one point, error called PRESS (prediction error sum of squares) Calculate error at each point and then presenting r.m.s error Can be shown that Can be used only if not ill-conditioned

14 Questions The pairs (0,0), (1,1), (2,1) represent strain (millistrains) and stress (ksi) measurements. Estimate Young modulus using the three commonly used error norms. Estimate the error in Young modulus using cross validation


Download ppt "Estimating the accuracy of the approximation (surrogate) From assumption that error is due to normally distributed uncorrelated random variables, get."

Similar presentations


Ads by Google