Presentation is loading. Please wait.

Presentation is loading. Please wait.

Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: type 1 error and type 2 error Original citation: Dougherty, C. (2012)

Similar presentations


Presentation on theme: "Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: type 1 error and type 2 error Original citation: Dougherty, C. (2012)"— Presentation transcript:

1 Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: type 1 error and type 2 error Original citation: Dougherty, C. (2012) EC220 - Introduction to econometrics (chapter 2). [Teaching Resource] © 2012 The Author This version available at: http://learningresources.lse.ac.uk/128/http://learningresources.lse.ac.uk/128/ Available in LSE Learning Resources Online: May 2012 This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 License. This license allows the user to remix, tweak, and build upon the work even for commercial purposes, as long as the user credits the author and licenses their new creations under the identical terms. http://creativecommons.org/licenses/by-sa/3.0/ http://creativecommons.org/licenses/by-sa/3.0/ http://learningresources.lse.ac.uk/

2 22  2 +sd  2 -sd TYPE I ERROR AND TYPE II ERROR 5% level hypothetical distribution under acceptance region for b 2 00000 b2b2  2 -1.96sd  2 +1.96sd 2.5% In the previous sequence a Type I error was defined to be the rejection of a null hypothesis when it happens to be true. 1

3 22  2 +sd  2 -sd TYPE I ERROR AND TYPE II ERROR 5% level hypothetical distribution under acceptance region for b 2 00000 b2b2  2 -1.96sd  2 +1.96sd 2.5% In hypothesis testing there is also a possibility of failing to reject the null hypothesis when it is in fact false. This is known as a Type II error. 2

4 22  2 +sd  2 -sd TYPE I ERROR AND TYPE II ERROR 5% level hypothetical distribution under acceptance region for b 2 00000 b2b2  2 -1.96sd  2 +1.96sd This sequence will demonstrate that there is a trade-off between the risk of making a Type I error and the risk of making a Type II error. 3 2.5%

5 22  2 +sd  2 -sd TYPE I ERROR AND TYPE II ERROR 5% level hypothetical distribution under acceptance region for b 2 00000 The diagram show the acceptance region and the rejection regions for a 5% significance test. The risk of making a Type I error, if the null hypothesis happens to be true, is 5%. 4 b2b2  2 -1.96sd  2 +1.96sd 2.5%

6 22  2 +sd  2 +2.58sd  2 -sd  2 -2.58sd 0.5% TYPE I ERROR AND TYPE II ERROR 5% level 1% level hypothetical distribution under acceptance region for b 2 00000 Using a 1% significance test, instead of a 5% test, reduces the risk of making a Type I error to 1%, if the null hypothesis is true. 5 b2b2

7 22  2 +sd  2 +2.58sd  2 -sd  2 -2.58sd 0.5% TYPE I ERROR AND TYPE II ERROR 5% level 1% level hypothetical distribution under acceptance region for b 2 00000 We will consider the implications of the choice of significance test for the case where the null hypothesis happens to be false. 6 b2b2

8 22  2 +sd  2 +2.58sd  2 -sd  2 -2.58sd 0.5% TYPE I ERROR AND TYPE II ERROR 7 5% level 1% level The diagram above explains how the test decisions are made, but it does not give the actual distribution of b 2. (For that reason the curve has been drawn with a dashed line.) b2b2 hypothetical distribution under acceptance region for b 2 00000

9 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under Suppose that H 1 :  2 =  2 1 is in fact true and the distribution of b 2 is therefore governed by the right-hand curve. 8

10 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under If we obtain some data and run a regression, the estimate b 2 might be as shown. In this case we would make the right decision and reject H 0, no matter which test we used. 9

11 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under Here is another estimate. Again, we would make the right decision and reject the null hypothesis, no matter whether we use the 5% test or the 1% test. 10

12 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under In the case shown, we would make a Type II error and fail to reject the null hypothesis, using either significance level. 11

13 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under But in the case of this estimate, we would make the right decision if we used a 5% test but we would make a Type II error if we used a 1% test. 12

14 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under The probability of making a Type II error if we use a 1% test is given by the probability of b 2 lying within the 1% acceptance region, the interval between the red vertical dotted lines. 13

15 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 hypothetical distribution under Given that H 1 is true, the probability of b 2 lying in the acceptance region is that area under the distribution for H 1 in the diagram - the pink shaded area in the diagram. 14

16 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd 011111 If instead we use a 5% significance test, the probability of making a Type II error if H 1 is true is given by the area under the distribution for H 1 in the acceptance region for the 5% test. 15 hypothetical distribution under

17 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 16 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd This is the gray shaded area in the diagram. In this particular case, using a 5% test instead of a 1% test would approximately halve the risk of making a Type II error. hypothetical distribution under 011111

18 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd hypothetical distribution under 011111 The problem, of course, is that you never know whether H 0 is true of false. If you did, why would you be performing a test? 17

19 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd hypothetical distribution under 011111 If H 0 happens to be true, using a 1% test instead of a 5% test greatly reduces the risk of making a Type I error (you cannot make a Type II error). 18

20 22 0.5% acceptance region for b 2 TYPE I ERROR AND TYPE II ERROR 5% level 1% level actual distribution under b2b2  2 +2sd  2 +sd 22  2 -sd  2 -2sd hypothetical distribution under 011111 However, if H 0 is false, using a 1% test instead of a 5% test increases the risk of making a Type II error (you cannot make a Type I error). 19

21 Copyright Christopher Dougherty 2011. These slideshows may be downloaded by anyone, anywhere for personal use. Subject to respect for copyright and, where appropriate, attribution, they may be used as a resource for teaching an econometrics course. There is no need to refer to the author. The content of this slideshow comes from Section 2.6 of C. Dougherty, Introduction to Econometrics, fourth edition 2011, Oxford University Press. Additional (free) resources for both students and instructors may be downloaded from the OUP Online Resource Centre http://www.oup.com/uk/orc/bin/9780199567089/http://www.oup.com/uk/orc/bin/9780199567089/. Individuals studying econometrics on their own and who feel that they might benefit from participation in a formal course should consider the London School of Economics summer school course EC212 Introduction to Econometrics http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx http://www2.lse.ac.uk/study/summerSchools/summerSchool/Home.aspx or the University of London International Programmes distance learning course 20 Elements of Econometrics www.londoninternational.ac.uk/lsewww.londoninternational.ac.uk/lse. 11.07.25


Download ppt "Christopher Dougherty EC220 - Introduction to econometrics (chapter 2) Slideshow: type 1 error and type 2 error Original citation: Dougherty, C. (2012)"

Similar presentations


Ads by Google