Download presentation

Presentation is loading. Please wait.

Published byJewel McDaniel Modified over 5 years ago

1
Session 2

2
Applied Regression -- Prof. Juran2 Outline for Session 2 More Simple Regression –Bottom Part of the Output Hypothesis Testing –Significance of the slope and intercept parameters Interval Estimation –Confidence intervals for the slope and intercept parameters

3
Applied Regression -- Prof. Juran3 Computer Repair Example

4
Applied Regression -- Prof. Juran4 Interpreting the Coefficients

5
Applied Regression -- Prof. Juran5 Things to remember: The Y value we might calculate by plugging an X into this equation is only an estimate (we will discuss this more later). These coefficients are only estimates; they are probably wrong (and we would therefore like to be able to think about how wrong they might be).

6
Applied Regression -- Prof. Juran6 Significance of the Coefficients Are the slope and intercept significantly different from zero? Can we construct a confidence interval around these coefficients? We need measures of dispersion for the estimated parameters.

7
Applied Regression -- Prof. Juran7 Statistics of the Regression Estimates If the true model is linear, the regression estimates are unbiased (correct expected value). If the true model is linear, the errors are uncorrelated, and the residual variance is constant in X, the regression estimates are also efficient (low variance relative to other estimators).

8
Applied Regression -- Prof. Juran8 The Statistics of the Regression Estimates If, in addition, the residuals are normally distributed, the estimates are random variables with distributions related to the t and 2 distributions. This permits a variety of hypothesis tests and confidence and prediction intervals to be computed. If the sample size is reasonably large and the residuals are not bizarrely non-normal, the hypothesis tests and confidence intervals are good approximations.

9
Applied Regression -- Prof. Juran9 Statistics of (estimated slope of the regression line) The true slope of the regression line, 1, is the most critical parameter. Under our full set of assumptions its estimate,, has the following properties: –It is unbiased: –It has variance: RABE 2.21

10
Applied Regression -- Prof. Juran10 –It has standard error –The “ t ” statistic below has a t -distribution with n -2 degrees of freedom. –A 2-sided confidence interval on 1 is RABE 2.24 RABE 2.28 RABE 2.33

11
Applied Regression -- Prof. Juran11 Statistics of (estimated intercept of the regression line) The true intercept of the regression line, 0, is sometimes of interest. Under our full set of assumptions its estimate,, has the following properties: –It is unbiased: –It has variance

12
Applied Regression -- Prof. Juran12 –It has standard error –The “ t ” statistic below has a t - distribution with n -2 degrees of freedom

13
Applied Regression -- Prof. Juran13 4-Step Hypothesis Testing Procedure 1.Formulate Two Hypotheses 2.Select a Test Statistic 3.Derive a Decision Rule 4.Calculate the Value of the Test Statistic; Invoke the Decision Rule in light of the Test Statistic

14
Applied Regression -- Prof. Juran14

15
Applied Regression -- Prof. Juran15

16
Applied Regression -- Prof. Juran16 Testing the significance of a simple linear regression ( 1 = 0? ) If the slope is zero (or, equivalently, if the correlation is zero) we do not have a relationship. Thus, a fundamental test is: H 0 : 1 = 0 versus H A : 1 0

17
Applied Regression -- Prof. Juran17 This can be carried out by a 2-sided t -test as follows: Reject H 0 if Equivalently, we can examine whether the confidence interval on 1 contains 0. Note : Parallel tests and confidence intervals exist for 0.

18
Applied Regression -- Prof. Juran18 Is the effect of “number of units repaired” on “minutes” different from zero? In other words, based on our sample data, which of these hypotheses is true? Hypothesis Testing Approach

19
Applied Regression -- Prof. Juran19

20
Applied Regression -- Prof. Juran20

21
Applied Regression -- Prof. Juran21

22
Applied Regression -- Prof. Juran22

23
Applied Regression -- Prof. Juran23

24
Applied Regression -- Prof. Juran24 The p -value

25
Applied Regression -- Prof. Juran25 What about the intercept? It would appear that our estimated intercept here is not significantly different from zero (see the p -value of 0.2385). It is not uncommon in practical situations to ignore a lack of significance in the intercept — the intercept is held to a lower standard of significance than the slope (or slopes).

26
Applied Regression -- Prof. Juran26

27
Applied Regression -- Prof. Juran27 Note that: the zero-intercept line is not much different from the best-fit line The best- fit line fits our data best (duh!) We seem to be able to make better predictions in our practical range of data using the best-fit model

28
Applied Regression -- Prof. Juran28 Confidence Interval Approach

29
Applied Regression -- Prof. Juran29 Excel Formulas

30
Applied Regression -- Prof. Juran30 Excel Formulas

31
Applied Regression -- Prof. Juran31 Note that both approaches (hypothesis testing and confidence intervals) use the same basic “picture” of sampling error: In the hypothesis testing approach, we center the picture on a hypothesized parameter value and see whether the data are consistent with the hypothesis. In the confidence interval approach, we center the picture on the data, and speculate that the true population parameter is probably nearby.

32
Applied Regression -- Prof. Juran32 The Regression Output

33
Applied Regression -- Prof. Juran33 Hypothesis Testing: Gardening Analogy Rocks Dirt

34
Applied Regression -- Prof. Juran34 Hypothesis Testing: Gardening Analogy

35
Applied Regression -- Prof. Juran35 Hypothesis Testing: Gardening Analogy

36
Applied Regression -- Prof. Juran36 Hypothesis Testing: Gardening Analogy

37
Applied Regression -- Prof. Juran37 Hypothesis Testing: Gardening Analogy Screened out stuff: Correct decision or Type I Error? Stuff that fell through: Correct decision or Type II Error?

38
Applied Regression -- Prof. Juran38 Stock Betas

39
Applied Regression -- Prof. Juran39

40
Applied Regression -- Prof. Juran40

41
Applied Regression -- Prof. Juran41

42
Applied Regression -- Prof. Juran42

43
Applied Regression -- Prof. Juran43

44
Applied Regression -- Prof. Juran44

45
Applied Regression -- Prof. Juran45

46
Applied Regression -- Prof. Juran46 More Simple Regression –Bottom Part of the Output Hypothesis Testing –Significance of the slope and intercept parameters Interval Estimation –Confidence intervals for the slope and intercept parameters Summary

47
Applied Regression -- Prof. Juran47 For Sessions 3 & 4 Organize a Project Team Review your regression notes from core stats Two cases: –All-Around Movers –Manley’s Insurance

Similar presentations

© 2020 SlidePlayer.com Inc.

All rights reserved.

To make this website work, we log user data and share it with processors. To use this website, you must agree to our Privacy Policy, including cookie policy.

Ads by Google